2023-11-13 04:53:15,386 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-11-13 04:53:15,633 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c16da608-f133-6e06-11cc-7a1f39f7083b 2023-11-13 04:53:15,645 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-11-13 04:53:15,646 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c16da608-f133-6e06-11cc-7a1f39f7083b/cluster_96bef9f4-be45-971b-7755-f6017f1a70ff, deleteOnExit=true 2023-11-13 04:53:15,646 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-11-13 04:53:15,646 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c16da608-f133-6e06-11cc-7a1f39f7083b/test.cache.data in system properties and HBase conf 2023-11-13 04:53:15,647 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c16da608-f133-6e06-11cc-7a1f39f7083b/hadoop.tmp.dir in system properties and HBase conf 2023-11-13 04:53:15,647 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c16da608-f133-6e06-11cc-7a1f39f7083b/hadoop.log.dir in system properties and HBase conf 2023-11-13 04:53:15,648 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c16da608-f133-6e06-11cc-7a1f39f7083b/mapreduce.cluster.local.dir in system properties and HBase conf 2023-11-13 04:53:15,648 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c16da608-f133-6e06-11cc-7a1f39f7083b/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-11-13 04:53:15,648 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-11-13 04:53:15,782 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-11-13 04:53:16,195 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-11-13 04:53:16,201 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c16da608-f133-6e06-11cc-7a1f39f7083b/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-11-13 04:53:16,201 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c16da608-f133-6e06-11cc-7a1f39f7083b/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-11-13 04:53:16,202 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c16da608-f133-6e06-11cc-7a1f39f7083b/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-11-13 04:53:16,202 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c16da608-f133-6e06-11cc-7a1f39f7083b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-11-13 04:53:16,203 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c16da608-f133-6e06-11cc-7a1f39f7083b/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-11-13 04:53:16,203 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c16da608-f133-6e06-11cc-7a1f39f7083b/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-11-13 04:53:16,204 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c16da608-f133-6e06-11cc-7a1f39f7083b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-11-13 04:53:16,204 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c16da608-f133-6e06-11cc-7a1f39f7083b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-11-13 04:53:16,205 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c16da608-f133-6e06-11cc-7a1f39f7083b/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-11-13 04:53:16,205 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c16da608-f133-6e06-11cc-7a1f39f7083b/nfs.dump.dir in system properties and HBase conf 2023-11-13 04:53:16,206 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c16da608-f133-6e06-11cc-7a1f39f7083b/java.io.tmpdir in system properties and HBase conf 2023-11-13 04:53:16,206 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c16da608-f133-6e06-11cc-7a1f39f7083b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-11-13 04:53:16,207 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c16da608-f133-6e06-11cc-7a1f39f7083b/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-11-13 04:53:16,207 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c16da608-f133-6e06-11cc-7a1f39f7083b/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-11-13 04:53:16,820 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-11-13 04:53:16,826 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-11-13 04:53:17,116 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-11-13 04:53:17,286 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-11-13 04:53:17,305 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-11-13 04:53:17,343 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-11-13 04:53:17,376 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c16da608-f133-6e06-11cc-7a1f39f7083b/java.io.tmpdir/Jetty_localhost_35337_hdfs____.yz4275/webapp 2023-11-13 04:53:17,517 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35337 2023-11-13 04:53:17,527 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-11-13 04:53:17,528 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-11-13 04:53:18,021 WARN [Listener at localhost/39509] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-11-13 04:53:18,124 WARN [Listener at localhost/39509] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-11-13 04:53:18,150 WARN [Listener at localhost/39509] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-11-13 04:53:18,157 INFO [Listener at localhost/39509] log.Slf4jLog(67): jetty-6.1.26 2023-11-13 04:53:18,164 INFO [Listener at localhost/39509] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c16da608-f133-6e06-11cc-7a1f39f7083b/java.io.tmpdir/Jetty_localhost_40249_datanode____.e407ry/webapp 2023-11-13 04:53:18,277 INFO [Listener at localhost/39509] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40249 2023-11-13 04:53:18,684 WARN [Listener at localhost/34517] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-11-13 04:53:19,257 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc581b45ee036f917: Processing first storage report for DS-e63129cf-fce9-44fe-b4fc-83bebffccc7d from datanode c05bfce7-1702-4e81-a2e6-d726294a2082 2023-11-13 04:53:19,259 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc581b45ee036f917: from storage DS-e63129cf-fce9-44fe-b4fc-83bebffccc7d node DatanodeRegistration(127.0.0.1:33559, datanodeUuid=c05bfce7-1702-4e81-a2e6-d726294a2082, infoPort=43433, infoSecurePort=0, ipcPort=34517, storageInfo=lv=-57;cid=testClusterID;nsid=924399592;c=1699851196904), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-11-13 04:53:19,259 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc581b45ee036f917: Processing first storage report for DS-2da7b857-73eb-47fd-98d1-6985948981f2 from datanode c05bfce7-1702-4e81-a2e6-d726294a2082 2023-11-13 04:53:19,259 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc581b45ee036f917: from storage DS-2da7b857-73eb-47fd-98d1-6985948981f2 node DatanodeRegistration(127.0.0.1:33559, datanodeUuid=c05bfce7-1702-4e81-a2e6-d726294a2082, infoPort=43433, infoSecurePort=0, ipcPort=34517, storageInfo=lv=-57;cid=testClusterID;nsid=924399592;c=1699851196904), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-11-13 04:53:19,340 DEBUG [Listener at localhost/34517] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c16da608-f133-6e06-11cc-7a1f39f7083b 2023-11-13 04:53:19,452 INFO [Listener at localhost/34517] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c16da608-f133-6e06-11cc-7a1f39f7083b/cluster_96bef9f4-be45-971b-7755-f6017f1a70ff/zookeeper_0, clientPort=51072, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c16da608-f133-6e06-11cc-7a1f39f7083b/cluster_96bef9f4-be45-971b-7755-f6017f1a70ff/zookeeper_0/version-2, dataDirSize=457 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c16da608-f133-6e06-11cc-7a1f39f7083b/cluster_96bef9f4-be45-971b-7755-f6017f1a70ff/zookeeper_0/version-2, dataLogSize=457 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, clientPortListenBacklog=-1, serverId=0 2023-11-13 04:53:19,468 INFO [Listener at localhost/34517] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=51072 2023-11-13 04:53:19,479 INFO [Listener at localhost/34517] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-13 04:53:19,481 INFO [Listener at localhost/34517] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-13 04:53:20,182 INFO [Listener at localhost/34517] util.FSUtils(471): Created version file at hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4 with version=8 2023-11-13 04:53:20,183 INFO [Listener at localhost/34517] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/hbase-staging 2023-11-13 04:53:20,492 INFO [Listener at localhost/34517] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-11-13 04:53:20,954 INFO [Listener at localhost/34517] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=3 2023-11-13 04:53:20,990 INFO [Listener at localhost/34517] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-13 04:53:20,991 INFO [Listener at localhost/34517] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-11-13 04:53:20,991 INFO [Listener at localhost/34517] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-11-13 04:53:20,991 INFO [Listener at localhost/34517] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-13 04:53:20,991 INFO [Listener at localhost/34517] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-11-13 04:53:21,163 INFO [Listener at localhost/34517] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-11-13 04:53:21,235 DEBUG [Listener at localhost/34517] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-11-13 04:53:21,329 INFO [Listener at localhost/34517] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33831 2023-11-13 04:53:21,339 INFO [Listener at localhost/34517] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-13 04:53:21,342 INFO [Listener at localhost/34517] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-13 04:53:21,364 INFO [Listener at localhost/34517] zookeeper.RecoverableZooKeeper(93): Process identifier=master:33831 connecting to ZooKeeper ensemble=127.0.0.1:51072 2023-11-13 04:53:21,409 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:338310x0, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-11-13 04:53:21,411 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:33831-0x101ddc61b680000 connected 2023-11-13 04:53:21,446 DEBUG [Listener at localhost/34517] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-13 04:53:21,447 DEBUG [Listener at localhost/34517] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-13 04:53:21,450 DEBUG [Listener at localhost/34517] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-11-13 04:53:21,458 DEBUG [Listener at localhost/34517] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33831 2023-11-13 04:53:21,458 DEBUG [Listener at localhost/34517] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33831 2023-11-13 04:53:21,458 DEBUG [Listener at localhost/34517] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33831 2023-11-13 04:53:21,459 DEBUG [Listener at localhost/34517] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33831 2023-11-13 04:53:21,459 DEBUG [Listener at localhost/34517] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33831 2023-11-13 04:53:21,465 INFO [Listener at localhost/34517] master.HMaster(444): hbase.rootdir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4, hbase.cluster.distributed=false 2023-11-13 04:53:21,532 INFO [Listener at localhost/34517] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=3 2023-11-13 04:53:21,533 INFO [Listener at localhost/34517] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-13 04:53:21,533 INFO [Listener at localhost/34517] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-11-13 04:53:21,533 INFO [Listener at localhost/34517] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-11-13 04:53:21,533 INFO [Listener at localhost/34517] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-13 04:53:21,533 INFO [Listener at localhost/34517] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-11-13 04:53:21,538 INFO [Listener at localhost/34517] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-11-13 04:53:21,540 INFO [Listener at localhost/34517] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41657 2023-11-13 04:53:21,542 INFO [Listener at localhost/34517] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-11-13 04:53:21,549 DEBUG [Listener at localhost/34517] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-11-13 04:53:21,549 INFO [Listener at localhost/34517] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-13 04:53:21,552 INFO [Listener at localhost/34517] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-13 04:53:21,554 INFO [Listener at localhost/34517] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41657 connecting to ZooKeeper ensemble=127.0.0.1:51072 2023-11-13 04:53:21,558 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:416570x0, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-11-13 04:53:21,559 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:41657-0x101ddc61b680001 connected 2023-11-13 04:53:21,559 DEBUG [Listener at localhost/34517] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-13 04:53:21,561 DEBUG [Listener at localhost/34517] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-13 04:53:21,561 DEBUG [Listener at localhost/34517] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-11-13 04:53:21,564 DEBUG [Listener at localhost/34517] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41657 2023-11-13 04:53:21,566 DEBUG [Listener at localhost/34517] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41657 2023-11-13 04:53:21,566 DEBUG [Listener at localhost/34517] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41657 2023-11-13 04:53:21,567 DEBUG [Listener at localhost/34517] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41657 2023-11-13 04:53:21,567 DEBUG [Listener at localhost/34517] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41657 2023-11-13 04:53:21,569 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,33831,1699851200322 2023-11-13 04:53:21,578 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-11-13 04:53:21,581 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,33831,1699851200322 2023-11-13 04:53:21,604 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-11-13 04:53:21,604 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-11-13 04:53:21,604 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-13 04:53:21,605 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-11-13 04:53:21,607 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,33831,1699851200322 from backup master directory 2023-11-13 04:53:21,607 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-11-13 04:53:21,610 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,33831,1699851200322 2023-11-13 04:53:21,610 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-11-13 04:53:21,611 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-11-13 04:53:21,611 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,33831,1699851200322 2023-11-13 04:53:21,614 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-11-13 04:53:21,615 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-11-13 04:53:21,703 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/hbase.id with ID: 5e50e0f9-bb37-4314-a7ec-847c1796a6fb 2023-11-13 04:53:21,744 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-13 04:53:21,758 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-13 04:53:21,803 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x29ce2801 to 127.0.0.1:51072 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-13 04:53:21,840 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64f2ab38, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-13 04:53:21,865 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-11-13 04:53:21,867 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-11-13 04:53:21,882 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-11-13 04:53:21,883 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-11-13 04:53:21,885 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-11-13 04:53:21,889 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-11-13 04:53:21,891 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-13 04:53:21,926 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/MasterData/data/master/store-tmp 2023-11-13 04:53:21,956 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-13 04:53:21,956 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-11-13 04:53:21,957 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-13 04:53:21,957 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-13 04:53:21,957 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-11-13 04:53:21,957 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-13 04:53:21,957 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-13 04:53:21,957 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-13 04:53:21,959 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/MasterData/WALs/jenkins-hbase4.apache.org,33831,1699851200322 2023-11-13 04:53:21,980 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33831%2C1699851200322, suffix=, logDir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/MasterData/WALs/jenkins-hbase4.apache.org,33831,1699851200322, archiveDir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/MasterData/oldWALs, maxLogs=10 2023-11-13 04:53:22,056 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33559,DS-e63129cf-fce9-44fe-b4fc-83bebffccc7d,DISK] 2023-11-13 04:53:22,065 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-11-13 04:53:22,131 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/MasterData/WALs/jenkins-hbase4.apache.org,33831,1699851200322/jenkins-hbase4.apache.org%2C33831%2C1699851200322.1699851201990 2023-11-13 04:53:22,132 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33559,DS-e63129cf-fce9-44fe-b4fc-83bebffccc7d,DISK]] 2023-11-13 04:53:22,132 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-11-13 04:53:22,133 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-13 04:53:22,136 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-11-13 04:53:22,137 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-11-13 04:53:22,205 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-11-13 04:53:22,212 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-11-13 04:53:22,239 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-11-13 04:53:22,251 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-13 04:53:22,258 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-11-13 04:53:22,260 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-11-13 04:53:22,277 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-11-13 04:53:22,281 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-13 04:53:22,283 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64542075, jitterRate=-0.03824813663959503}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-13 04:53:22,283 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-13 04:53:22,284 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-11-13 04:53:22,301 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-11-13 04:53:22,302 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-11-13 04:53:22,304 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-11-13 04:53:22,306 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-11-13 04:53:22,342 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 35 msec 2023-11-13 04:53:22,342 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-11-13 04:53:22,369 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-11-13 04:53:22,376 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-11-13 04:53:22,410 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-11-13 04:53:22,416 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-11-13 04:53:22,418 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-11-13 04:53:22,425 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-11-13 04:53:22,431 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-11-13 04:53:22,435 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-13 04:53:22,437 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-11-13 04:53:22,437 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-11-13 04:53:22,454 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-11-13 04:53:22,462 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-11-13 04:53:22,462 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-11-13 04:53:22,463 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-13 04:53:22,463 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,33831,1699851200322, sessionid=0x101ddc61b680000, setting cluster-up flag (Was=false) 2023-11-13 04:53:22,485 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-13 04:53:22,491 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-11-13 04:53:22,494 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33831,1699851200322 2023-11-13 04:53:22,501 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-13 04:53:22,508 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-11-13 04:53:22,510 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33831,1699851200322 2023-11-13 04:53:22,512 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.hbase-snapshot/.tmp 2023-11-13 04:53:22,572 INFO [RS:0;jenkins-hbase4:41657] regionserver.HRegionServer(951): ClusterId : 5e50e0f9-bb37-4314-a7ec-847c1796a6fb 2023-11-13 04:53:22,577 DEBUG [RS:0;jenkins-hbase4:41657] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-11-13 04:53:22,587 DEBUG [RS:0;jenkins-hbase4:41657] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-11-13 04:53:22,587 DEBUG [RS:0;jenkins-hbase4:41657] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-11-13 04:53:22,594 DEBUG [RS:0;jenkins-hbase4:41657] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-11-13 04:53:22,596 DEBUG [RS:0;jenkins-hbase4:41657] zookeeper.ReadOnlyZKClient(139): Connect 0x320de6d4 to 127.0.0.1:51072 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-13 04:53:22,601 DEBUG [RS:0;jenkins-hbase4:41657] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3cca1ee5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-13 04:53:22,601 DEBUG [RS:0;jenkins-hbase4:41657] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@38f58da4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-11-13 04:53:22,629 DEBUG [RS:0;jenkins-hbase4:41657] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:41657 2023-11-13 04:53:22,634 INFO [RS:0;jenkins-hbase4:41657] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-11-13 04:53:22,634 INFO [RS:0;jenkins-hbase4:41657] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-11-13 04:53:22,634 DEBUG [RS:0;jenkins-hbase4:41657] regionserver.HRegionServer(1022): About to register with Master. 2023-11-13 04:53:22,635 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-11-13 04:53:22,638 INFO [RS:0;jenkins-hbase4:41657] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33831,1699851200322 with isa=jenkins-hbase4.apache.org/172.31.14.131:41657, startcode=1699851201532 2023-11-13 04:53:22,648 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-13 04:53:22,648 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-13 04:53:22,648 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-13 04:53:22,649 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-13 04:53:22,649 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-11-13 04:53:22,649 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-13 04:53:22,649 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-11-13 04:53:22,649 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-13 04:53:22,653 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1699851232652 2023-11-13 04:53:22,655 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-11-13 04:53:22,656 DEBUG [RS:0;jenkins-hbase4:41657] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-11-13 04:53:22,658 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-11-13 04:53:22,659 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-11-13 04:53:22,665 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-11-13 04:53:22,668 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-11-13 04:53:22,675 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-11-13 04:53:22,675 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-11-13 04:53:22,676 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-11-13 04:53:22,676 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-11-13 04:53:22,676 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-11-13 04:53:22,679 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-11-13 04:53:22,681 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-11-13 04:53:22,681 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-11-13 04:53:22,687 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-11-13 04:53:22,688 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-11-13 04:53:22,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1699851202689,5,FailOnTimeoutGroup] 2023-11-13 04:53:22,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1699851202689,5,FailOnTimeoutGroup] 2023-11-13 04:53:22,689 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-11-13 04:53:22,690 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-11-13 04:53:22,691 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-11-13 04:53:22,692 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-11-13 04:53:22,705 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-11-13 04:53:22,706 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-11-13 04:53:22,706 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4 2023-11-13 04:53:22,719 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-13 04:53:22,721 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-11-13 04:53:22,722 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59673, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-11-13 04:53:22,724 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/hbase/meta/1588230740/info 2023-11-13 04:53:22,725 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-11-13 04:53:22,727 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-13 04:53:22,727 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-11-13 04:53:22,730 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/hbase/meta/1588230740/rep_barrier 2023-11-13 04:53:22,730 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-11-13 04:53:22,731 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-13 04:53:22,731 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-11-13 04:53:22,734 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/hbase/meta/1588230740/table 2023-11-13 04:53:22,734 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-11-13 04:53:22,735 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33831] master.ServerManager(388): Registering regionserver=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:22,736 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-13 04:53:22,737 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/hbase/meta/1588230740 2023-11-13 04:53:22,738 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/hbase/meta/1588230740 2023-11-13 04:53:22,742 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-11-13 04:53:22,744 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-11-13 04:53:22,748 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-13 04:53:22,749 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71650795, jitterRate=0.06768004596233368}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-11-13 04:53:22,749 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-11-13 04:53:22,749 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-11-13 04:53:22,749 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-11-13 04:53:22,749 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-11-13 04:53:22,749 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-11-13 04:53:22,749 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-11-13 04:53:22,751 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-11-13 04:53:22,752 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-11-13 04:53:22,757 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-11-13 04:53:22,757 DEBUG [RS:0;jenkins-hbase4:41657] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4 2023-11-13 04:53:22,757 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-11-13 04:53:22,757 DEBUG [RS:0;jenkins-hbase4:41657] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:39509 2023-11-13 04:53:22,757 DEBUG [RS:0;jenkins-hbase4:41657] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-11-13 04:53:22,764 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-13 04:53:22,765 DEBUG [RS:0;jenkins-hbase4:41657] zookeeper.ZKUtil(162): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:22,766 WARN [RS:0;jenkins-hbase4:41657] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-11-13 04:53:22,766 INFO [RS:0;jenkins-hbase4:41657] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-13 04:53:22,766 DEBUG [RS:0;jenkins-hbase4:41657] regionserver.HRegionServer(1948): logDir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/WALs/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:22,767 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41657,1699851201532] 2023-11-13 04:53:22,767 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-11-13 04:53:22,778 DEBUG [RS:0;jenkins-hbase4:41657] zookeeper.ZKUtil(162): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:22,783 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-11-13 04:53:22,786 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-11-13 04:53:22,790 DEBUG [RS:0;jenkins-hbase4:41657] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-11-13 04:53:22,798 INFO [RS:0;jenkins-hbase4:41657] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-11-13 04:53:22,816 INFO [RS:0;jenkins-hbase4:41657] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-11-13 04:53:22,820 INFO [RS:0;jenkins-hbase4:41657] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-13 04:53:22,820 INFO [RS:0;jenkins-hbase4:41657] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-13 04:53:22,821 INFO [RS:0;jenkins-hbase4:41657] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-11-13 04:53:22,829 INFO [RS:0;jenkins-hbase4:41657] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-11-13 04:53:22,830 DEBUG [RS:0;jenkins-hbase4:41657] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-13 04:53:22,830 DEBUG [RS:0;jenkins-hbase4:41657] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-13 04:53:22,830 DEBUG [RS:0;jenkins-hbase4:41657] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-13 04:53:22,830 DEBUG [RS:0;jenkins-hbase4:41657] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-13 04:53:22,830 DEBUG [RS:0;jenkins-hbase4:41657] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-13 04:53:22,830 DEBUG [RS:0;jenkins-hbase4:41657] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-11-13 04:53:22,830 DEBUG [RS:0;jenkins-hbase4:41657] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-13 04:53:22,831 DEBUG [RS:0;jenkins-hbase4:41657] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-13 04:53:22,831 DEBUG [RS:0;jenkins-hbase4:41657] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-13 04:53:22,831 DEBUG [RS:0;jenkins-hbase4:41657] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-13 04:53:22,832 INFO [RS:0;jenkins-hbase4:41657] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-11-13 04:53:22,832 INFO [RS:0;jenkins-hbase4:41657] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-11-13 04:53:22,832 INFO [RS:0;jenkins-hbase4:41657] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-11-13 04:53:22,849 INFO [RS:0;jenkins-hbase4:41657] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-11-13 04:53:22,851 INFO [RS:0;jenkins-hbase4:41657] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41657,1699851201532-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-11-13 04:53:22,871 INFO [RS:0;jenkins-hbase4:41657] regionserver.Replication(203): jenkins-hbase4.apache.org,41657,1699851201532 started 2023-11-13 04:53:22,871 INFO [RS:0;jenkins-hbase4:41657] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,41657,1699851201532, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41657, sessionid=0x101ddc61b680001 2023-11-13 04:53:22,872 DEBUG [RS:0;jenkins-hbase4:41657] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-11-13 04:53:22,872 DEBUG [RS:0;jenkins-hbase4:41657] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:22,872 DEBUG [RS:0;jenkins-hbase4:41657] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41657,1699851201532' 2023-11-13 04:53:22,872 DEBUG [RS:0;jenkins-hbase4:41657] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:22,873 DEBUG [RS:0;jenkins-hbase4:41657] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:22,874 DEBUG [RS:0;jenkins-hbase4:41657] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-11-13 04:53:22,874 DEBUG [RS:0;jenkins-hbase4:41657] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-11-13 04:53:22,874 DEBUG [RS:0;jenkins-hbase4:41657] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:22,874 DEBUG [RS:0;jenkins-hbase4:41657] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41657,1699851201532' 2023-11-13 04:53:22,874 DEBUG [RS:0;jenkins-hbase4:41657] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-13 04:53:22,874 DEBUG [RS:0;jenkins-hbase4:41657] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-13 04:53:22,875 DEBUG [RS:0;jenkins-hbase4:41657] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-11-13 04:53:22,875 INFO [RS:0;jenkins-hbase4:41657] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-11-13 04:53:22,875 INFO [RS:0;jenkins-hbase4:41657] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-11-13 04:53:22,938 DEBUG [jenkins-hbase4:33831] assignment.AssignmentManager(2186): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-11-13 04:53:22,941 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41657,1699851201532, state=OPENING 2023-11-13 04:53:22,948 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-11-13 04:53:22,950 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-13 04:53:22,951 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-11-13 04:53:22,954 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41657,1699851201532}] 2023-11-13 04:53:22,987 INFO [RS:0;jenkins-hbase4:41657] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41657%2C1699851201532, suffix=, logDir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/WALs/jenkins-hbase4.apache.org,41657,1699851201532, archiveDir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/oldWALs, maxLogs=32 2023-11-13 04:53:23,016 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33559,DS-e63129cf-fce9-44fe-b4fc-83bebffccc7d,DISK] 2023-11-13 04:53:23,020 INFO [RS:0;jenkins-hbase4:41657] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/WALs/jenkins-hbase4.apache.org,41657,1699851201532/jenkins-hbase4.apache.org%2C41657%2C1699851201532.1699851202993 2023-11-13 04:53:23,024 DEBUG [RS:0;jenkins-hbase4:41657] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33559,DS-e63129cf-fce9-44fe-b4fc-83bebffccc7d,DISK]] 2023-11-13 04:53:23,150 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:23,152 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-13 04:53:23,156 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54700, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-13 04:53:23,173 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-11-13 04:53:23,174 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-13 04:53:23,178 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41657%2C1699851201532.meta, suffix=.meta, logDir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/WALs/jenkins-hbase4.apache.org,41657,1699851201532, archiveDir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/oldWALs, maxLogs=32 2023-11-13 04:53:23,202 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33559,DS-e63129cf-fce9-44fe-b4fc-83bebffccc7d,DISK] 2023-11-13 04:53:23,206 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/WALs/jenkins-hbase4.apache.org,41657,1699851201532/jenkins-hbase4.apache.org%2C41657%2C1699851201532.meta.1699851203180.meta 2023-11-13 04:53:23,209 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33559,DS-e63129cf-fce9-44fe-b4fc-83bebffccc7d,DISK]] 2023-11-13 04:53:23,209 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-11-13 04:53:23,211 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-11-13 04:53:23,230 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-11-13 04:53:23,236 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-11-13 04:53:23,242 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-11-13 04:53:23,242 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-13 04:53:23,242 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-11-13 04:53:23,242 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-11-13 04:53:23,246 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-11-13 04:53:23,249 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/hbase/meta/1588230740/info 2023-11-13 04:53:23,249 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/hbase/meta/1588230740/info 2023-11-13 04:53:23,250 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-11-13 04:53:23,250 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-13 04:53:23,251 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-11-13 04:53:23,252 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/hbase/meta/1588230740/rep_barrier 2023-11-13 04:53:23,252 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/hbase/meta/1588230740/rep_barrier 2023-11-13 04:53:23,253 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-11-13 04:53:23,254 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-13 04:53:23,254 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-11-13 04:53:23,255 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/hbase/meta/1588230740/table 2023-11-13 04:53:23,256 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/hbase/meta/1588230740/table 2023-11-13 04:53:23,256 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-11-13 04:53:23,257 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-13 04:53:23,259 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/hbase/meta/1588230740 2023-11-13 04:53:23,262 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/hbase/meta/1588230740 2023-11-13 04:53:23,265 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-11-13 04:53:23,268 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-11-13 04:53:23,270 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62315509, jitterRate=-0.07142655551433563}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-11-13 04:53:23,270 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-11-13 04:53:23,280 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1699851203139 2023-11-13 04:53:23,299 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-11-13 04:53:23,300 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-11-13 04:53:23,300 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41657,1699851201532, state=OPEN 2023-11-13 04:53:23,307 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-11-13 04:53:23,308 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-11-13 04:53:23,312 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-11-13 04:53:23,313 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41657,1699851201532 in 354 msec 2023-11-13 04:53:23,319 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-11-13 04:53:23,319 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 548 msec 2023-11-13 04:53:23,325 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 766 msec 2023-11-13 04:53:23,325 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1699851203325, completionTime=-1 2023-11-13 04:53:23,325 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(808): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-11-13 04:53:23,326 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1527): Joining cluster... 2023-11-13 04:53:23,400 DEBUG [hconnection-0x33c15d7d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-13 04:53:23,403 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54702, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-13 04:53:23,419 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1539): Number of RegionServers=1 2023-11-13 04:53:23,419 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1699851263419 2023-11-13 04:53:23,419 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1699851323419 2023-11-13 04:53:23,420 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1546): Joined the cluster in 93 msec 2023-11-13 04:53:23,441 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33831,1699851200322-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-11-13 04:53:23,442 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33831,1699851200322-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-11-13 04:53:23,442 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33831,1699851200322-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-11-13 04:53:23,443 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:33831, period=300000, unit=MILLISECONDS is enabled. 2023-11-13 04:53:23,444 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-11-13 04:53:23,449 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-11-13 04:53:23,457 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-11-13 04:53:23,458 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-11-13 04:53:23,467 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-11-13 04:53:23,469 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-11-13 04:53:23,474 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-13 04:53:23,500 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/hbase/namespace/b407be211f78e6f863b566bf7b56412d 2023-11-13 04:53:23,503 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/hbase/namespace/b407be211f78e6f863b566bf7b56412d empty. 2023-11-13 04:53:23,504 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/hbase/namespace/b407be211f78e6f863b566bf7b56412d 2023-11-13 04:53:23,504 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-11-13 04:53:23,529 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-11-13 04:53:23,534 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => b407be211f78e6f863b566bf7b56412d, NAME => 'hbase:namespace,,1699851203458.b407be211f78e6f863b566bf7b56412d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp 2023-11-13 04:53:23,559 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1699851203458.b407be211f78e6f863b566bf7b56412d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-13 04:53:23,559 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing b407be211f78e6f863b566bf7b56412d, disabling compactions & flushes 2023-11-13 04:53:23,559 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1699851203458.b407be211f78e6f863b566bf7b56412d. 2023-11-13 04:53:23,559 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1699851203458.b407be211f78e6f863b566bf7b56412d. 2023-11-13 04:53:23,559 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1699851203458.b407be211f78e6f863b566bf7b56412d. after waiting 0 ms 2023-11-13 04:53:23,560 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1699851203458.b407be211f78e6f863b566bf7b56412d. 2023-11-13 04:53:23,560 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1699851203458.b407be211f78e6f863b566bf7b56412d. 2023-11-13 04:53:23,560 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for b407be211f78e6f863b566bf7b56412d: 2023-11-13 04:53:23,565 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-11-13 04:53:23,580 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1699851203458.b407be211f78e6f863b566bf7b56412d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1699851203568"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699851203568"}]},"ts":"1699851203568"} 2023-11-13 04:53:23,607 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-13 04:53:23,608 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-13 04:53:23,613 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699851203609"}]},"ts":"1699851203609"} 2023-11-13 04:53:23,616 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-11-13 04:53:23,625 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=b407be211f78e6f863b566bf7b56412d, ASSIGN}] 2023-11-13 04:53:23,627 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=b407be211f78e6f863b566bf7b56412d, ASSIGN 2023-11-13 04:53:23,629 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=b407be211f78e6f863b566bf7b56412d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41657,1699851201532; forceNewPlan=false, retain=false 2023-11-13 04:53:23,780 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=b407be211f78e6f863b566bf7b56412d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:23,781 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1699851203458.b407be211f78e6f863b566bf7b56412d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1699851203780"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699851203780"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699851203780"}]},"ts":"1699851203780"} 2023-11-13 04:53:23,786 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure b407be211f78e6f863b566bf7b56412d, server=jenkins-hbase4.apache.org,41657,1699851201532}] 2023-11-13 04:53:23,940 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:23,948 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1699851203458.b407be211f78e6f863b566bf7b56412d. 2023-11-13 04:53:23,949 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b407be211f78e6f863b566bf7b56412d, NAME => 'hbase:namespace,,1699851203458.b407be211f78e6f863b566bf7b56412d.', STARTKEY => '', ENDKEY => ''} 2023-11-13 04:53:23,951 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace b407be211f78e6f863b566bf7b56412d 2023-11-13 04:53:23,951 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1699851203458.b407be211f78e6f863b566bf7b56412d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-13 04:53:23,951 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b407be211f78e6f863b566bf7b56412d 2023-11-13 04:53:23,951 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b407be211f78e6f863b566bf7b56412d 2023-11-13 04:53:23,954 INFO [StoreOpener-b407be211f78e6f863b566bf7b56412d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region b407be211f78e6f863b566bf7b56412d 2023-11-13 04:53:23,957 DEBUG [StoreOpener-b407be211f78e6f863b566bf7b56412d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/hbase/namespace/b407be211f78e6f863b566bf7b56412d/info 2023-11-13 04:53:23,957 DEBUG [StoreOpener-b407be211f78e6f863b566bf7b56412d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/hbase/namespace/b407be211f78e6f863b566bf7b56412d/info 2023-11-13 04:53:23,957 INFO [StoreOpener-b407be211f78e6f863b566bf7b56412d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b407be211f78e6f863b566bf7b56412d columnFamilyName info 2023-11-13 04:53:23,958 INFO [StoreOpener-b407be211f78e6f863b566bf7b56412d-1] regionserver.HStore(310): Store=b407be211f78e6f863b566bf7b56412d/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-13 04:53:23,960 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/hbase/namespace/b407be211f78e6f863b566bf7b56412d 2023-11-13 04:53:23,961 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/hbase/namespace/b407be211f78e6f863b566bf7b56412d 2023-11-13 04:53:23,969 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b407be211f78e6f863b566bf7b56412d 2023-11-13 04:53:23,973 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/hbase/namespace/b407be211f78e6f863b566bf7b56412d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-13 04:53:23,974 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b407be211f78e6f863b566bf7b56412d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74272174, jitterRate=0.10674163699150085}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-13 04:53:23,974 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b407be211f78e6f863b566bf7b56412d: 2023-11-13 04:53:23,976 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1699851203458.b407be211f78e6f863b566bf7b56412d., pid=6, masterSystemTime=1699851203940 2023-11-13 04:53:23,980 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1699851203458.b407be211f78e6f863b566bf7b56412d. 2023-11-13 04:53:23,980 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1699851203458.b407be211f78e6f863b566bf7b56412d. 2023-11-13 04:53:23,982 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=b407be211f78e6f863b566bf7b56412d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:23,982 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1699851203458.b407be211f78e6f863b566bf7b56412d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1699851203981"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699851203981"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699851203981"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699851203981"}]},"ts":"1699851203981"} 2023-11-13 04:53:23,991 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-11-13 04:53:23,991 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure b407be211f78e6f863b566bf7b56412d, server=jenkins-hbase4.apache.org,41657,1699851201532 in 201 msec 2023-11-13 04:53:23,995 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-11-13 04:53:23,996 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=b407be211f78e6f863b566bf7b56412d, ASSIGN in 367 msec 2023-11-13 04:53:23,997 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-13 04:53:23,998 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699851203998"}]},"ts":"1699851203998"} 2023-11-13 04:53:24,001 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-11-13 04:53:24,005 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-11-13 04:53:24,008 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 546 msec 2023-11-13 04:53:24,070 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-11-13 04:53:24,077 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-11-13 04:53:24,077 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-13 04:53:24,111 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-11-13 04:53:24,125 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-13 04:53:24,130 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 26 msec 2023-11-13 04:53:24,135 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-11-13 04:53:24,148 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-13 04:53:24,154 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-11-13 04:53:24,161 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-11-13 04:53:24,165 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-11-13 04:53:24,167 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.556sec 2023-11-13 04:53:24,168 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-11-13 04:53:24,170 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-11-13 04:53:24,170 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-11-13 04:53:24,171 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33831,1699851200322-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-11-13 04:53:24,171 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33831,1699851200322-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-11-13 04:53:24,179 DEBUG [Listener at localhost/34517] zookeeper.ReadOnlyZKClient(139): Connect 0x36d9c5a6 to 127.0.0.1:51072 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-13 04:53:24,183 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-11-13 04:53:24,184 DEBUG [Listener at localhost/34517] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@35f0769d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-13 04:53:24,196 DEBUG [hconnection-0x5c51df4d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-13 04:53:24,209 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54716, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-13 04:53:24,220 INFO [Listener at localhost/34517] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,33831,1699851200322 2023-11-13 04:53:24,222 DEBUG [Listener at localhost/34517] zookeeper.ReadOnlyZKClient(139): Connect 0x65c25ebc to 127.0.0.1:51072 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-13 04:53:24,227 DEBUG [Listener at localhost/34517] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@517aa6c4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-13 04:53:24,227 INFO [Listener at localhost/34517] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-13 04:53:24,265 INFO [Listener at localhost/34517] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=215, OpenFileDescriptor=505, MaxFileDescriptor=60000, SystemLoadAverage=250, ProcessCount=169, AvailableMemoryMB=3246 2023-11-13 04:53:24,276 DEBUG [Listener at localhost/34517] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-13 04:53:24,279 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33698, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-13 04:53:24,291 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-13 04:53:24,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:24,295 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-11-13 04:53:24,297 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-13 04:53:24,300 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-11-13 04:53:24,301 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84 2023-11-13 04:53:24,303 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84 empty. 2023-11-13 04:53:24,305 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84 2023-11-13 04:53:24,305 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-11-13 04:53:24,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-13 04:53:24,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-13 04:53:24,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-13 04:53:24,724 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-11-13 04:53:24,727 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7675): creating {ENCODED => e04c69bd7378d342c6ee08c3af87ad84, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp 2023-11-13 04:53:24,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-13 04:53:25,143 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-13 04:53:25,144 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1604): Closing e04c69bd7378d342c6ee08c3af87ad84, disabling compactions & flushes 2023-11-13 04:53:25,144 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84. 2023-11-13 04:53:25,144 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84. 2023-11-13 04:53:25,144 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84. after waiting 0 ms 2023-11-13 04:53:25,144 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84. 2023-11-13 04:53:25,144 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84. 2023-11-13 04:53:25,144 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1558): Region close journal for e04c69bd7378d342c6ee08c3af87ad84: 2023-11-13 04:53:25,150 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-11-13 04:53:25,151 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1699851205151"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699851205151"}]},"ts":"1699851205151"} 2023-11-13 04:53:25,155 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-13 04:53:25,156 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-13 04:53:25,157 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699851205156"}]},"ts":"1699851205156"} 2023-11-13 04:53:25,159 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-11-13 04:53:25,168 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=e04c69bd7378d342c6ee08c3af87ad84, ASSIGN}] 2023-11-13 04:53:25,170 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=e04c69bd7378d342c6ee08c3af87ad84, ASSIGN 2023-11-13 04:53:25,172 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=e04c69bd7378d342c6ee08c3af87ad84, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41657,1699851201532; forceNewPlan=false, retain=false 2023-11-13 04:53:25,323 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=e04c69bd7378d342c6ee08c3af87ad84, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:25,324 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1699851205323"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699851205323"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699851205323"}]},"ts":"1699851205323"} 2023-11-13 04:53:25,328 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure e04c69bd7378d342c6ee08c3af87ad84, server=jenkins-hbase4.apache.org,41657,1699851201532}] 2023-11-13 04:53:25,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-13 04:53:25,482 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:25,488 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84. 2023-11-13 04:53:25,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e04c69bd7378d342c6ee08c3af87ad84, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84.', STARTKEY => '', ENDKEY => ''} 2023-11-13 04:53:25,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly e04c69bd7378d342c6ee08c3af87ad84 2023-11-13 04:53:25,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-13 04:53:25,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e04c69bd7378d342c6ee08c3af87ad84 2023-11-13 04:53:25,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e04c69bd7378d342c6ee08c3af87ad84 2023-11-13 04:53:25,493 INFO [StoreOpener-e04c69bd7378d342c6ee08c3af87ad84-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e04c69bd7378d342c6ee08c3af87ad84 2023-11-13 04:53:25,495 DEBUG [StoreOpener-e04c69bd7378d342c6ee08c3af87ad84-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1 2023-11-13 04:53:25,495 DEBUG [StoreOpener-e04c69bd7378d342c6ee08c3af87ad84-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1 2023-11-13 04:53:25,499 INFO [StoreOpener-e04c69bd7378d342c6ee08c3af87ad84-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e04c69bd7378d342c6ee08c3af87ad84 columnFamilyName family1 2023-11-13 04:53:25,504 INFO [StoreOpener-e04c69bd7378d342c6ee08c3af87ad84-1] regionserver.HStore(310): Store=e04c69bd7378d342c6ee08c3af87ad84/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-13 04:53:25,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84 2023-11-13 04:53:25,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84 2023-11-13 04:53:25,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e04c69bd7378d342c6ee08c3af87ad84 2023-11-13 04:53:25,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-13 04:53:25,516 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e04c69bd7378d342c6ee08c3af87ad84; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74411626, jitterRate=0.1088196337223053}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-13 04:53:25,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e04c69bd7378d342c6ee08c3af87ad84: 2023-11-13 04:53:25,518 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84., pid=11, masterSystemTime=1699851205481 2023-11-13 04:53:25,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84. 2023-11-13 04:53:25,521 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84. 2023-11-13 04:53:25,521 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=e04c69bd7378d342c6ee08c3af87ad84, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:25,522 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1699851205521"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699851205521"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699851205521"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699851205521"}]},"ts":"1699851205521"} 2023-11-13 04:53:25,527 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-11-13 04:53:25,527 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure e04c69bd7378d342c6ee08c3af87ad84, server=jenkins-hbase4.apache.org,41657,1699851201532 in 196 msec 2023-11-13 04:53:25,530 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-11-13 04:53:25,531 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=e04c69bd7378d342c6ee08c3af87ad84, ASSIGN in 359 msec 2023-11-13 04:53:25,532 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-13 04:53:25,532 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699851205532"}]},"ts":"1699851205532"} 2023-11-13 04:53:25,534 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-11-13 04:53:25,538 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-11-13 04:53:25,541 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.2460 sec 2023-11-13 04:53:26,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-13 04:53:26,430 INFO [Listener at localhost/34517] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-11-13 04:53:26,454 DEBUG [hconnection-0x5339b42f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-13 04:53:26,457 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47648, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-13 04:53:26,617 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:53:26,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:26,624 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-13 04:53:26,625 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:26,625 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-13 04:53:26,625 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-13 04:53:26,626 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:26,626 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:26,628 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:26,628 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:26,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:26,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:26,628 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:26,628 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:53:26,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:26,629 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:26,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:53:26,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:26,630 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:26,632 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:26,633 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-13 04:53:26,633 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:26,633 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-13 04:53:26,634 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:53:26,634 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84. 2023-11-13 04:53:26,634 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:53:26,635 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84. started... 2023-11-13 04:53:26,636 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e04c69bd7378d342c6ee08c3af87ad84 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-13 04:53:27,199 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130d846ebfb87374e2eab82c19caf01eb74 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130d846ebfb87374e2eab82c19caf01eb74 2023-11-13 04:53:27,227 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/.tmp/family1/c52a69a7a171406687d971b396f1d23d 2023-11-13 04:53:27,239 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/.tmp/family1/c52a69a7a171406687d971b396f1d23d as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/c52a69a7a171406687d971b396f1d23d 2023-11-13 04:53:27,249 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/c52a69a7a171406687d971b396f1d23d, entries=1000, sequenceid=5, filesize=175.8 K 2023-11-13 04:53:27,253 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for e04c69bd7378d342c6ee08c3af87ad84 in 617ms, sequenceid=5, compaction requested=false 2023-11-13 04:53:27,254 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-13 04:53:27,257 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e04c69bd7378d342c6ee08c3af87ad84: 2023-11-13 04:53:27,257 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84. 2023-11-13 04:53:27,257 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:53:27,258 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:53:27,258 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:27,258 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-13 04:53:27,258 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-13 04:53:27,262 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:27,262 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:27,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:27,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:27,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:27,263 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:27,263 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:53:27,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:27,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:27,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:27,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:27,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:27,266 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-13 04:53:27,266 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-13 04:53:27,266 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:27,266 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4888469b[Count = 0] remaining members to acquire global barrier 2023-11-13 04:53:27,268 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:27,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:27,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:27,268 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-13 04:53:27,268 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:27,268 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-13 04:53:27,269 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:53:27,269 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:53:27,273 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:27,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:27,274 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-13 04:53:27,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:27,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:27,274 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:27,274 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-13 04:53:27,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:27,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:27,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:27,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:27,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:27,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:27,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:27,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:53:27,280 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-13 04:53:27,280 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-13 04:53:27,280 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:53:27,280 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:53:27,280 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:27,281 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:53:27,284 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:27,284 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:27,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:27,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:27,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:27,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:27,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:27,284 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:27,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:27,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:27,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:27,286 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:27,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:27,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:27,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:27,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:27,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:27,289 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:27,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:27,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:27,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:27,299 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:27,299 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:27,299 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:27,299 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:27,299 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:27,299 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:27,299 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:27,299 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:27,300 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:27,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:27,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:27,300 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:27,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:27,300 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-13 04:53:27,301 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:53:27,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:27,303 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-13 04:53:27,303 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:53:27,403 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:53:27,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:53:27,419 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:53:27,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-13 04:53:27,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:27,423 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-13 04:53:27,423 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:27,423 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-13 04:53:27,423 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-13 04:53:27,424 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:27,424 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:27,428 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:27,428 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:27,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:27,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:27,429 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:27,429 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:53:27,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:27,430 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:27,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:53:27,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:27,430 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:27,430 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-13 04:53:27,431 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:27,431 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-13 04:53:27,431 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:27,431 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-13 04:53:27,431 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:53:27,431 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:53:27,431 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84. 2023-11-13 04:53:27,431 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84. started... 2023-11-13 04:53:27,432 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e04c69bd7378d342c6ee08c3af87ad84 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-13 04:53:27,859 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112892c50c77ee6b4d06aa4fd3d097209f5f to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112892c50c77ee6b4d06aa4fd3d097209f5f 2023-11-13 04:53:28,271 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/.tmp/family1/9041ab127af24878b01ce1f3064d6954 2023-11-13 04:53:28,284 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/.tmp/family1/9041ab127af24878b01ce1f3064d6954 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/9041ab127af24878b01ce1f3064d6954 2023-11-13 04:53:28,295 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/9041ab127af24878b01ce1f3064d6954, entries=1, sequenceid=9, filesize=5.0 K 2023-11-13 04:53:28,297 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for e04c69bd7378d342c6ee08c3af87ad84 in 865ms, sequenceid=9, compaction requested=false 2023-11-13 04:53:28,297 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e04c69bd7378d342c6ee08c3af87ad84: 2023-11-13 04:53:28,297 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84. 2023-11-13 04:53:28,297 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:53:28,297 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:53:28,297 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:28,297 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-13 04:53:28,298 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-13 04:53:28,301 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:28,301 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:28,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:28,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:28,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:28,302 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:28,302 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:53:28,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:28,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:28,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:28,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:28,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:28,305 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-13 04:53:28,305 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39044a96[Count = 0] remaining members to acquire global barrier 2023-11-13 04:53:28,305 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-13 04:53:28,305 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:28,306 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:28,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:28,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:28,307 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-13 04:53:28,307 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-13 04:53:28,307 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:53:28,307 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:28,307 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:53:28,310 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:28,310 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-13 04:53:28,310 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:28,310 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-13 04:53:28,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:28,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:28,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:28,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:28,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:28,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:28,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:28,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:28,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:28,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:28,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:53:28,320 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-13 04:53:28,320 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-13 04:53:28,320 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:53:28,320 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:53:28,320 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:28,320 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:53:28,323 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:28,323 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:28,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:28,323 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:28,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:28,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:28,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:28,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:28,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:28,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:28,324 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:28,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:28,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:28,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:28,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:28,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:28,330 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:28,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:28,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:28,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:28,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:28,338 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:28,338 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:28,338 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:28,338 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:28,338 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:28,338 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:28,338 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:28,338 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:28,338 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:28,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:28,339 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-13 04:53:28,339 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:53:28,339 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:28,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:28,340 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-13 04:53:28,340 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-13 04:53:28,340 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:53:28,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:28,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:28,440 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:53:28,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:53:28,453 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:53:28,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-13 04:53:28,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:28,457 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-13 04:53:28,457 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:28,458 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-13 04:53:28,458 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-13 04:53:28,459 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:28,459 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:28,461 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:28,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:28,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:28,461 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:28,462 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:28,462 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:53:28,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:28,463 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:28,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:53:28,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:28,464 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:28,469 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-13 04:53:28,469 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:28,469 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-13 04:53:28,469 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:28,470 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-13 04:53:28,470 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:53:28,470 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:53:28,470 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84. 2023-11-13 04:53:28,470 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84. started... 2023-11-13 04:53:28,471 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e04c69bd7378d342c6ee08c3af87ad84 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:53:28,767 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-13 04:53:28,828 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-11-13 04:53:28,830 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-11-13 04:53:28,915 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201c22048dca56b499d9f1ebef90aaa2d70 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201c22048dca56b499d9f1ebef90aaa2d70 2023-11-13 04:53:29,327 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/.tmp/family1/1cbc73b558cf43e389dd50bc661983af 2023-11-13 04:53:29,336 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/.tmp/family1/1cbc73b558cf43e389dd50bc661983af as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/1cbc73b558cf43e389dd50bc661983af 2023-11-13 04:53:29,344 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/1cbc73b558cf43e389dd50bc661983af, entries=1, sequenceid=13, filesize=5.0 K 2023-11-13 04:53:29,345 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e04c69bd7378d342c6ee08c3af87ad84 in 875ms, sequenceid=13, compaction requested=true 2023-11-13 04:53:29,345 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e04c69bd7378d342c6ee08c3af87ad84: 2023-11-13 04:53:29,345 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84. 2023-11-13 04:53:29,345 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:53:29,346 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:53:29,346 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:29,346 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-13 04:53:29,346 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-13 04:53:29,348 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:29,348 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:29,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:29,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:29,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:29,349 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:29,349 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:53:29,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:29,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:29,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:29,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:29,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:29,351 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-13 04:53:29,351 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@462da73e[Count = 0] remaining members to acquire global barrier 2023-11-13 04:53:29,351 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-13 04:53:29,351 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:29,353 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:29,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:29,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:29,353 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-13 04:53:29,353 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-13 04:53:29,353 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:53:29,353 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:29,353 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:53:29,356 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-13 04:53:29,357 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:29,357 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:29,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:29,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:29,357 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-13 04:53:29,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:29,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:29,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:29,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:29,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:29,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:29,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:29,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:29,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:53:29,361 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-13 04:53:29,361 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-13 04:53:29,361 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:53:29,361 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:53:29,361 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:29,361 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:53:29,364 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:29,364 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:29,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:29,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:29,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:29,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:29,365 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:29,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:29,367 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:29,369 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:29,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:29,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:29,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:29,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:29,372 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:29,372 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:29,372 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:29,372 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:29,372 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:29,372 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:29,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:29,372 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:29,372 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:29,373 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:29,373 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-13 04:53:29,373 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:53:29,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:29,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:29,373 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:29,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:29,374 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-13 04:53:29,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:29,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:29,374 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:53:29,375 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-13 04:53:29,474 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:53:29,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:53:29,485 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:53:29,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-13 04:53:29,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:29,490 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-13 04:53:29,490 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:29,491 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-13 04:53:29,491 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-13 04:53:29,492 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:29,492 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:29,494 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:29,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:29,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:29,494 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:29,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:29,495 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:29,495 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:53:29,495 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:29,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:53:29,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:29,496 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:29,497 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-13 04:53:29,497 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:29,497 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-13 04:53:29,497 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:29,497 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-13 04:53:29,498 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:53:29,498 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:53:29,498 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84. 2023-11-13 04:53:29,498 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84. started... 2023-11-13 04:53:29,498 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e04c69bd7378d342c6ee08c3af87ad84 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:53:29,926 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205256850a2fa804ab1ba1f4bd10e880edb to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205256850a2fa804ab1ba1f4bd10e880edb 2023-11-13 04:53:30,345 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/.tmp/family1/c37c37afcd454c5badaa967aec973d4e 2023-11-13 04:53:30,354 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/.tmp/family1/c37c37afcd454c5badaa967aec973d4e as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/c37c37afcd454c5badaa967aec973d4e 2023-11-13 04:53:30,363 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/c37c37afcd454c5badaa967aec973d4e, entries=1, sequenceid=17, filesize=5.0 K 2023-11-13 04:53:30,364 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e04c69bd7378d342c6ee08c3af87ad84 in 866ms, sequenceid=17, compaction requested=true 2023-11-13 04:53:30,364 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e04c69bd7378d342c6ee08c3af87ad84: 2023-11-13 04:53:30,364 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84. 2023-11-13 04:53:30,364 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:53:30,365 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:53:30,365 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:30,366 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-13 04:53:30,366 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-13 04:53:30,368 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:30,368 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:30,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:30,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:30,369 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:30,369 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:53:30,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:30,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:30,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:30,371 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-13 04:53:30,371 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@40991d[Count = 0] remaining members to acquire global barrier 2023-11-13 04:53:30,371 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-13 04:53:30,371 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,373 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,373 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-13 04:53:30,373 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-13 04:53:30,373 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:53:30,373 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:30,373 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:53:30,375 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-13 04:53:30,375 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:30,375 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:30,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:30,375 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-13 04:53:30,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:30,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:30,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:30,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:30,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:30,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:30,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:30,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:53:30,379 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-13 04:53:30,379 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-13 04:53:30,379 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:53:30,379 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:53:30,379 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,379 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:53:30,387 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,387 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:30,387 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:30,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:30,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:30,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:30,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:30,388 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:30,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:30,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:30,390 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:30,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:30,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:30,394 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:30,394 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:30,394 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:30,395 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:30,395 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:30,395 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-13 04:53:30,395 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:53:30,395 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:30,395 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:30,395 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,395 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:30,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:30,395 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,396 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-13 04:53:30,396 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:53:30,488 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-11-13 04:53:30,488 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-11-13 04:53:30,496 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:53:30,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:53:30,506 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:53:30,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-13 04:53:30,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,509 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-13 04:53:30,509 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:30,510 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-13 04:53:30,510 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-13 04:53:30,510 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,510 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,513 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:30,513 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:30,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:30,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:30,513 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:30,513 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:53:30,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,514 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:53:30,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,514 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,515 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-13 04:53:30,515 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,515 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-13 04:53:30,515 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:30,515 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-13 04:53:30,516 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:53:30,516 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:53:30,516 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84. 2023-11-13 04:53:30,516 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84. started... 2023-11-13 04:53:30,516 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e04c69bd7378d342c6ee08c3af87ad84 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:53:30,546 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512282771d73f2f4247e689107c5745560fd3 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512282771d73f2f4247e689107c5745560fd3 2023-11-13 04:53:30,557 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/.tmp/family1/b42b2810600f493a98692d6f0e686d68 2023-11-13 04:53:30,565 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/.tmp/family1/b42b2810600f493a98692d6f0e686d68 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/b42b2810600f493a98692d6f0e686d68 2023-11-13 04:53:30,573 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/b42b2810600f493a98692d6f0e686d68, entries=1, sequenceid=21, filesize=5.0 K 2023-11-13 04:53:30,574 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e04c69bd7378d342c6ee08c3af87ad84 in 58ms, sequenceid=21, compaction requested=true 2023-11-13 04:53:30,575 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e04c69bd7378d342c6ee08c3af87ad84: 2023-11-13 04:53:30,575 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84. 2023-11-13 04:53:30,575 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:53:30,575 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:53:30,575 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:30,575 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-13 04:53:30,575 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-13 04:53:30,577 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:30,577 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:30,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:30,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:30,578 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,578 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:53:30,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:30,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:30,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:30,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:30,580 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-13 04:53:30,580 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a76ab10[Count = 0] remaining members to acquire global barrier 2023-11-13 04:53:30,580 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-13 04:53:30,580 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,582 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,582 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-13 04:53:30,582 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-13 04:53:30,582 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:53:30,582 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:30,582 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:53:30,584 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-13 04:53:30,584 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:30,584 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:30,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:30,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:30,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:30,584 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-13 04:53:30,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:30,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:30,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:30,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:30,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:30,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:53:30,588 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-13 04:53:30,588 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-13 04:53:30,588 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:53:30,588 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:53:30,588 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,588 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:53:30,591 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,591 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:30,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:30,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,591 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:30,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:30,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:30,591 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:30,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:30,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:30,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:30,593 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:30,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:30,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:30,596 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:30,597 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,597 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:30,597 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:30,597 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:30,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:30,597 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:30,597 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-13 04:53:30,597 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:53:30,597 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,597 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:30,597 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,598 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:30,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:30,598 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-13 04:53:30,598 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:53:30,698 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:53:30,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:53:30,708 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:53:30,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-13 04:53:30,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,713 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-13 04:53:30,713 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:30,713 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-13 04:53:30,714 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-13 04:53:30,714 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,714 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,716 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:30,716 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:30,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:30,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:30,717 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:30,717 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:53:30,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,718 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:53:30,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,719 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,719 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-13 04:53:30,719 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,719 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-13 04:53:30,719 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:30,720 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-13 04:53:30,720 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:53:30,720 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:53:30,720 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84. 2023-11-13 04:53:30,720 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84. started... 2023-11-13 04:53:30,720 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e04c69bd7378d342c6ee08c3af87ad84 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:53:30,745 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231c4c5cc3fec7a41e2b61cc6671a8c44d9 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231c4c5cc3fec7a41e2b61cc6671a8c44d9 2023-11-13 04:53:30,757 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/.tmp/family1/93dd71a8ec624ab88743a80a38c1b3ac 2023-11-13 04:53:30,766 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/.tmp/family1/93dd71a8ec624ab88743a80a38c1b3ac as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/93dd71a8ec624ab88743a80a38c1b3ac 2023-11-13 04:53:30,773 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/93dd71a8ec624ab88743a80a38c1b3ac, entries=1, sequenceid=25, filesize=5.0 K 2023-11-13 04:53:30,775 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e04c69bd7378d342c6ee08c3af87ad84 in 55ms, sequenceid=25, compaction requested=true 2023-11-13 04:53:30,775 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e04c69bd7378d342c6ee08c3af87ad84: 2023-11-13 04:53:30,775 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84. 2023-11-13 04:53:30,775 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:53:30,776 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:53:30,776 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:30,776 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-13 04:53:30,776 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-13 04:53:30,778 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:30,778 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:30,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:30,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:30,779 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,779 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:53:30,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:30,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:30,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:30,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:30,782 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-13 04:53:30,782 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@113d0032[Count = 0] remaining members to acquire global barrier 2023-11-13 04:53:30,782 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-13 04:53:30,782 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,783 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,784 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-13 04:53:30,784 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-13 04:53:30,784 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:53:30,784 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:30,784 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:53:30,786 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:30,786 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-13 04:53:30,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:30,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:30,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:30,786 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:30,786 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-13 04:53:30,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:30,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:30,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:30,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:30,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:30,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:53:30,791 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-13 04:53:30,791 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-13 04:53:30,791 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:53:30,791 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:53:30,791 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,791 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:53:30,794 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,794 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,794 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:30,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:30,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:30,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:30,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:30,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:30,795 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:30,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:30,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,797 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:30,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:30,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:30,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:30,800 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:30,800 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:30,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:30,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:30,800 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:30,800 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:30,800 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,800 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-13 04:53:30,800 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-13 04:53:30,801 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:53:30,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:30,800 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:30,801 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:30,801 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,801 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,801 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,801 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-13 04:53:30,801 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:53:30,902 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:53:30,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:53:30,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:53:30,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-13 04:53:30,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,915 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-13 04:53:30,915 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:30,915 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-13 04:53:30,915 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-13 04:53:30,916 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,916 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,918 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:30,918 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:30,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:30,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:30,918 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:30,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,918 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:53:30,919 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:53:30,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,920 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,920 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-13 04:53:30,920 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:30,920 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-13 04:53:30,920 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:30,920 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-13 04:53:30,921 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:53:30,921 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:53:30,921 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84. 2023-11-13 04:53:30,921 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84. started... 2023-11-13 04:53:30,921 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e04c69bd7378d342c6ee08c3af87ad84 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:53:30,953 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101029f3b5fb7874e38be4067e4074868d2 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101029f3b5fb7874e38be4067e4074868d2 2023-11-13 04:53:30,998 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/.tmp/family1/db193535f0a5448a8250dd18f2a4ead5 2023-11-13 04:53:31,007 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/.tmp/family1/db193535f0a5448a8250dd18f2a4ead5 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/db193535f0a5448a8250dd18f2a4ead5 2023-11-13 04:53:31,015 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/db193535f0a5448a8250dd18f2a4ead5, entries=1, sequenceid=29, filesize=5.0 K 2023-11-13 04:53:31,016 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e04c69bd7378d342c6ee08c3af87ad84 in 95ms, sequenceid=29, compaction requested=true 2023-11-13 04:53:31,016 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e04c69bd7378d342c6ee08c3af87ad84: 2023-11-13 04:53:31,017 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84. 2023-11-13 04:53:31,017 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:53:31,017 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:53:31,017 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:31,017 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-13 04:53:31,017 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-13 04:53:31,030 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:31,030 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:31,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:31,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:31,031 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,031 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:53:31,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:31,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:31,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:31,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:31,033 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-13 04:53:31,033 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3a02417c[Count = 0] remaining members to acquire global barrier 2023-11-13 04:53:31,033 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-13 04:53:31,033 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,035 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,035 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-13 04:53:31,035 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-13 04:53:31,035 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:53:31,035 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:31,035 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:53:31,037 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-13 04:53:31,037 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:31,037 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:31,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:31,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:31,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:31,037 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-13 04:53:31,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:31,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:31,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:31,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:31,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:31,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:53:31,041 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-13 04:53:31,041 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-13 04:53:31,041 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:53:31,041 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:53:31,041 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,041 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:53:31,043 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,043 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,043 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:31,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:31,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:31,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:31,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:31,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:31,043 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:31,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:31,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,045 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:31,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:31,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:31,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:31,049 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:31,049 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,049 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,049 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:31,049 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:31,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:31,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:31,049 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:31,049 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,049 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:31,049 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-13 04:53:31,049 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,049 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-13 04:53:31,050 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:53:31,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:31,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:31,050 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,050 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-13 04:53:31,050 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:53:31,151 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:53:31,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:53:31,161 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:53:31,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-13 04:53:31,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,164 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-13 04:53:31,164 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:31,164 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-13 04:53:31,164 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-13 04:53:31,165 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,165 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,167 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:31,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:31,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:31,167 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:31,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,168 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:31,168 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:53:31,168 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:53:31,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,169 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,169 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-13 04:53:31,169 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,170 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-13 04:53:31,170 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:31,170 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-13 04:53:31,170 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:53:31,170 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:53:31,170 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84. 2023-11-13 04:53:31,170 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84. started... 2023-11-13 04:53:31,170 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e04c69bd7378d342c6ee08c3af87ad84 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:53:31,591 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103b5cd45dd50b740b6934b35ae3112023c to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103b5cd45dd50b740b6934b35ae3112023c 2023-11-13 04:53:31,599 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/.tmp/family1/cfc5109194f64beebcef4dc3f0b98992 2023-11-13 04:53:31,606 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/.tmp/family1/cfc5109194f64beebcef4dc3f0b98992 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/cfc5109194f64beebcef4dc3f0b98992 2023-11-13 04:53:31,613 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/cfc5109194f64beebcef4dc3f0b98992, entries=1, sequenceid=33, filesize=5.0 K 2023-11-13 04:53:31,614 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e04c69bd7378d342c6ee08c3af87ad84 in 444ms, sequenceid=33, compaction requested=true 2023-11-13 04:53:31,614 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e04c69bd7378d342c6ee08c3af87ad84: 2023-11-13 04:53:31,614 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84. 2023-11-13 04:53:31,614 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:53:31,615 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:53:31,615 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:31,615 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-13 04:53:31,615 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-13 04:53:31,617 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:31,617 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:31,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:31,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:31,618 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:31,618 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:53:31,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:31,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:31,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:31,619 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-13 04:53:31,620 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3e0ebf50[Count = 0] remaining members to acquire global barrier 2023-11-13 04:53:31,620 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-13 04:53:31,620 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,622 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,622 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-13 04:53:31,622 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-13 04:53:31,622 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:53:31,622 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:31,622 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:53:31,624 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-13 04:53:31,624 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:31,624 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:31,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:31,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:31,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:31,624 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-13 04:53:31,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:31,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:31,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:31,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:31,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:31,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:53:31,628 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-13 04:53:31,628 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-13 04:53:31,628 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:53:31,628 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:53:31,628 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,628 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:53:31,630 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,631 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:31,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,631 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:31,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:31,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:31,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:31,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:31,631 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:31,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:31,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:31,633 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:31,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:31,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:31,637 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:31,637 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,637 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,637 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:31,637 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:31,637 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:31,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:31,637 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,637 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-13 04:53:31,637 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:31,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:31,638 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:53:31,637 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,638 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:31,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:31,638 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-13 04:53:31,639 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:53:31,739 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:53:31,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:53:31,747 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:53:31,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-13 04:53:31,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,750 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-13 04:53:31,750 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:31,751 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-13 04:53:31,751 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-13 04:53:31,751 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,751 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,754 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:31,754 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:31,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:31,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:31,754 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:31,754 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:53:31,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,755 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:53:31,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,755 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,755 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-13 04:53:31,756 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:31,756 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-13 04:53:31,756 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:31,756 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-13 04:53:31,756 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:53:31,756 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:53:31,756 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84. 2023-11-13 04:53:31,756 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84. started... 2023-11-13 04:53:31,756 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e04c69bd7378d342c6ee08c3af87ad84 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:53:32,176 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509070695ed1fe392472f8a43552f684ff707 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201509070695ed1fe392472f8a43552f684ff707 2023-11-13 04:53:32,586 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/.tmp/family1/fded408177404dbe87fb5f2db0c7dc38 2023-11-13 04:53:32,596 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/.tmp/family1/fded408177404dbe87fb5f2db0c7dc38 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/fded408177404dbe87fb5f2db0c7dc38 2023-11-13 04:53:32,604 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/fded408177404dbe87fb5f2db0c7dc38, entries=1, sequenceid=37, filesize=5.0 K 2023-11-13 04:53:32,605 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e04c69bd7378d342c6ee08c3af87ad84 in 849ms, sequenceid=37, compaction requested=true 2023-11-13 04:53:32,606 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e04c69bd7378d342c6ee08c3af87ad84: 2023-11-13 04:53:32,606 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84. 2023-11-13 04:53:32,606 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:53:32,606 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:53:32,606 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:32,606 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-13 04:53:32,606 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-13 04:53:32,609 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:32,609 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:32,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:32,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:32,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:32,610 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:32,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:32,610 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:53:32,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:32,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:32,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:32,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:32,613 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-13 04:53:32,613 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19fadaa[Count = 0] remaining members to acquire global barrier 2023-11-13 04:53:32,613 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-13 04:53:32,613 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:32,615 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:32,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:32,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:32,615 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-13 04:53:32,615 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-13 04:53:32,615 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:32,615 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:53:32,615 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:53:32,617 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:32,617 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-13 04:53:32,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:32,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:32,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:32,617 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:32,617 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-13 04:53:32,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:32,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:32,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:32,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:32,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:32,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:32,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:32,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:53:32,621 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-13 04:53:32,621 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-13 04:53:32,621 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:53:32,621 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:53:32,621 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:32,621 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:53:32,624 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:32,624 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:32,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:32,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:32,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:32,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:32,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:32,624 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:32,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:32,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:32,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:32,625 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:32,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:32,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:32,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:32,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:32,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:32,627 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:32,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:32,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:32,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:32,633 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:32,633 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:32,633 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:32,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:32,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:32,633 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:32,633 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:32,633 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-13 04:53:32,634 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:53:32,633 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:32,633 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:32,634 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:32,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:32,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:32,634 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:32,634 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-13 04:53:32,634 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:32,634 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:53:32,735 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:53:32,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:53:32,743 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:53:32,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-13 04:53:32,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:32,745 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-13 04:53:32,745 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:32,745 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-13 04:53:32,745 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-13 04:53:32,746 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:32,746 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:32,748 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:32,748 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:32,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:32,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:32,748 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:32,748 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:53:32,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:32,749 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:32,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:53:32,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:32,749 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:32,749 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-13 04:53:32,750 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:32,750 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-13 04:53:32,750 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:32,751 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-13 04:53:32,751 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:53:32,751 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:53:32,751 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84. 2023-11-13 04:53:32,751 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84. started... 2023-11-13 04:53:32,751 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e04c69bd7378d342c6ee08c3af87ad84 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:53:33,170 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112057013be41c1f457da37acc38a1e8a050 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112057013be41c1f457da37acc38a1e8a050 2023-11-13 04:53:33,580 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/.tmp/family1/5b9c937f07cd4049b7039d8b47126125 2023-11-13 04:53:33,590 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/.tmp/family1/5b9c937f07cd4049b7039d8b47126125 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/5b9c937f07cd4049b7039d8b47126125 2023-11-13 04:53:33,598 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/5b9c937f07cd4049b7039d8b47126125, entries=1, sequenceid=41, filesize=5.0 K 2023-11-13 04:53:33,600 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e04c69bd7378d342c6ee08c3af87ad84 in 849ms, sequenceid=41, compaction requested=true 2023-11-13 04:53:33,600 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e04c69bd7378d342c6ee08c3af87ad84: 2023-11-13 04:53:33,600 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84. 2023-11-13 04:53:33,600 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:53:33,600 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:53:33,600 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:33,600 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-13 04:53:33,600 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-13 04:53:33,604 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:33,604 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:33,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:33,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:33,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:33,604 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:33,604 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:53:33,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:33,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:33,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:33,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:33,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:33,606 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-13 04:53:33,607 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@785a013b[Count = 0] remaining members to acquire global barrier 2023-11-13 04:53:33,607 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-13 04:53:33,607 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:33,608 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:33,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:33,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:33,609 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-13 04:53:33,609 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-13 04:53:33,609 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:53:33,609 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:33,609 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:53:33,611 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:33,611 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-13 04:53:33,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:33,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:33,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:33,611 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:33,611 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-13 04:53:33,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:33,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:33,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:33,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:33,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:33,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:33,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:33,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:53:33,616 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-13 04:53:33,616 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-13 04:53:33,616 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:53:33,616 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:53:33,616 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:33,616 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:53:33,618 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:33,618 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:33,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:33,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:33,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:33,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:33,619 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:33,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:33,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:33,619 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:33,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:33,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:33,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:33,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:33,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:33,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:33,625 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:33,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:33,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:33,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:33,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:33,630 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:33,630 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:33,630 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:33,630 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:33,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:33,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:33,630 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:33,630 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:33,630 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-13 04:53:33,630 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:53:33,630 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-13 04:53:33,630 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:33,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:33,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:33,631 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:33,631 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:33,631 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:33,631 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-13 04:53:33,631 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:53:33,731 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:53:33,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:53:33,737 DEBUG [Listener at localhost/34517] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-13 04:53:33,740 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36490, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-13 04:53:33,741 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33831] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:33,753 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-13 04:53:33,754 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-13 04:53:33,756 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-13 04:53:33,756 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699851813756 2023-11-13 04:53:33,757 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-13 04:53:33,761 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-11-13 04:53:33,761 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-13 04:53:33,762 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] zookeeper.ReadOnlyZKClient(139): Connect 0x586dde8d to 127.0.0.1:51072 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-13 04:53:33,766 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@224d335, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-13 04:53:33,768 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-13 04:53:34,236 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103752b58424a474609865075b8968d6c35 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103752b58424a474609865075b8968d6c35 2023-11-13 04:53:34,237 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-13 04:53:34,256 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-13 04:53:34,258 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47664, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-13 04:53:34,270 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-13 04:53:34,271 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36506, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-13 04:53:34,306 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/f023c009621a49a39f19d4cfd58d9464 first=Optional[r3] last=Optional[r6] 2023-11-13 04:53:34,319 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84., hostname=jenkins-hbase4.apache.org,41657,1699851201532, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/f023c009621a49a39f19d4cfd58d9464}] 2023-11-13 04:53:34,335 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(763): Validating hfile at hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/f023c009621a49a39f19d4cfd58d9464 for inclusion in e04c69bd7378d342c6ee08c3af87ad84/family1 2023-11-13 04:53:34,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-13 04:53:34,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(777): Region bounds: first= last= 2023-11-13 04:53:34,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HRegion(2446): Flush status journal for e04c69bd7378d342c6ee08c3af87ad84: 2023-11-13 04:53:34,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/f023c009621a49a39f19d4cfd58d9464 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__ehc564uujbtrlk7m7jae1phkpsd2tmafaqe9rts8ttg46p3gj9mthnh5g92hth60/family1/f023c009621a49a39f19d4cfd58d9464 2023-11-13 04:53:34,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__ehc564uujbtrlk7m7jae1phkpsd2tmafaqe9rts8ttg46p3gj9mthnh5g92hth60/family1/f023c009621a49a39f19d4cfd58d9464 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/4869625383bc4818a5c6d47ff862efd6_SeqId_44_ 2023-11-13 04:53:34,347 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(849): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__ehc564uujbtrlk7m7jae1phkpsd2tmafaqe9rts8ttg46p3gj9mthnh5g92hth60/family1/f023c009621a49a39f19d4cfd58d9464 into e04c69bd7378d342c6ee08c3af87ad84/family1 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/4869625383bc4818a5c6d47ff862efd6_SeqId_44_ - updating store file list. 2023-11-13 04:53:34,353 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(882): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/4869625383bc4818a5c6d47ff862efd6_SeqId_44_ into e04c69bd7378d342c6ee08c3af87ad84/family1 2023-11-13 04:53:34,353 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(855): Successfully loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__ehc564uujbtrlk7m7jae1phkpsd2tmafaqe9rts8ttg46p3gj9mthnh5g92hth60/family1/f023c009621a49a39f19d4cfd58d9464 into e04c69bd7378d342c6ee08c3af87ad84/family1 (new location: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/4869625383bc4818a5c6d47ff862efd6_SeqId_44_) 2023-11-13 04:53:34,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__ehc564uujbtrlk7m7jae1phkpsd2tmafaqe9rts8ttg46p3gj9mthnh5g92hth60/family1/f023c009621a49a39f19d4cfd58d9464 2023-11-13 04:53:34,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-13 04:53:34,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-13 04:53:34,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(1912): e04c69bd7378d342c6ee08c3af87ad84/family1 is initiating minor compaction 2023-11-13 04:53:34,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4b9e513b; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-13 04:53:34,365 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of e04c69bd7378d342c6ee08c3af87ad84/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84. 2023-11-13 04:53:34,366 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/9041ab127af24878b01ce1f3064d6954, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/1cbc73b558cf43e389dd50bc661983af, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/c37c37afcd454c5badaa967aec973d4e, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/b42b2810600f493a98692d6f0e686d68, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/93dd71a8ec624ab88743a80a38c1b3ac, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/db193535f0a5448a8250dd18f2a4ead5, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/cfc5109194f64beebcef4dc3f0b98992, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/fded408177404dbe87fb5f2db0c7dc38, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/5b9c937f07cd4049b7039d8b47126125, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/4869625383bc4818a5c6d47ff862efd6_SeqId_44_] into tmpdir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/.tmp, totalSize=50.2 K 2023-11-13 04:53:34,366 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 9041ab127af24878b01ce1f3064d6954, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-13 04:53:34,367 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 1cbc73b558cf43e389dd50bc661983af, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-13 04:53:34,367 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting c37c37afcd454c5badaa967aec973d4e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-13 04:53:34,367 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting b42b2810600f493a98692d6f0e686d68, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-13 04:53:34,367 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 93dd71a8ec624ab88743a80a38c1b3ac, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-13 04:53:34,367 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting db193535f0a5448a8250dd18f2a4ead5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-13 04:53:34,367 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting cfc5109194f64beebcef4dc3f0b98992, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-13 04:53:34,367 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting fded408177404dbe87fb5f2db0c7dc38, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-13 04:53:34,367 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 5b9c937f07cd4049b7039d8b47126125, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-13 04:53:34,367 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 4869625383bc4818a5c6d47ff862efd6_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-13 04:53:34,380 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-13 04:53:34,382 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:53:34,387 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512282771d73f2f4247e689107c5745560fd3 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512282771d73f2f4247e689107c5745560fd3 2023-11-13 04:53:34,389 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231c4c5cc3fec7a41e2b61cc6671a8c44d9 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231c4c5cc3fec7a41e2b61cc6671a8c44d9 2023-11-13 04:53:34,391 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101029f3b5fb7874e38be4067e4074868d2 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101029f3b5fb7874e38be4067e4074868d2 2023-11-13 04:53:34,393 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103b5cd45dd50b740b6934b35ae3112023c to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103b5cd45dd50b740b6934b35ae3112023c 2023-11-13 04:53:34,393 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-11-13 04:53:34,393 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-13 04:53:34,394 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-13 04:53:34,394 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-13 04:53:34,394 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-13 04:53:34,394 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-13 04:53:34,394 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-13 04:53:34,394 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-13 04:53:34,394 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-13 04:53:34,394 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-13 04:53:34,436 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] throttle.PressureAwareThroughputController(145): e04c69bd7378d342c6ee08c3af87ad84#family1#compaction#10 average throughput is 0.21 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-13 04:53:35,270 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/.tmp/family1/101d9fbc72814c7091d7a9c54bafeb09 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/101d9fbc72814c7091d7a9c54bafeb09 2023-11-13 04:53:35,288 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in e04c69bd7378d342c6ee08c3af87ad84/family1 of e04c69bd7378d342c6ee08c3af87ad84 into 101d9fbc72814c7091d7a9c54bafeb09(size=6.6 K), total size for store is 182.5 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-13 04:53:35,288 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for e04c69bd7378d342c6ee08c3af87ad84: 2023-11-13 04:53:35,289 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1699851214363; duration=0sec 2023-11-13 04:53:35,290 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-13 04:53:35,302 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512052afe72edcf9f41cf9b0ccdca7a5ae5c0 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512052afe72edcf9f41cf9b0ccdca7a5ae5c0 2023-11-13 04:53:35,304 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-13 04:53:35,350 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/9041ab127af24878b01ce1f3064d6954, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/1cbc73b558cf43e389dd50bc661983af, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/c37c37afcd454c5badaa967aec973d4e, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/b42b2810600f493a98692d6f0e686d68, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/93dd71a8ec624ab88743a80a38c1b3ac, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/db193535f0a5448a8250dd18f2a4ead5, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/cfc5109194f64beebcef4dc3f0b98992, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/fded408177404dbe87fb5f2db0c7dc38, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/5b9c937f07cd4049b7039d8b47126125, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/4869625383bc4818a5c6d47ff862efd6_SeqId_44_] to archive 2023-11-13 04:53:35,352 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:53:35,355 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/9041ab127af24878b01ce1f3064d6954 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/9041ab127af24878b01ce1f3064d6954 2023-11-13 04:53:35,357 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/da9107d1e809426d8be4c1c75715b517 first=Optional[r00] last=Optional[r2] 2023-11-13 04:53:35,358 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84., hostname=jenkins-hbase4.apache.org,41657,1699851201532, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/da9107d1e809426d8be4c1c75715b517}] 2023-11-13 04:53:35,358 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/1cbc73b558cf43e389dd50bc661983af to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/1cbc73b558cf43e389dd50bc661983af 2023-11-13 04:53:35,360 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/c37c37afcd454c5badaa967aec973d4e to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/c37c37afcd454c5badaa967aec973d4e 2023-11-13 04:53:35,361 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(763): Validating hfile at hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/da9107d1e809426d8be4c1c75715b517 for inclusion in e04c69bd7378d342c6ee08c3af87ad84/family1 2023-11-13 04:53:35,363 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/b42b2810600f493a98692d6f0e686d68 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/b42b2810600f493a98692d6f0e686d68 2023-11-13 04:53:35,366 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/93dd71a8ec624ab88743a80a38c1b3ac to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/93dd71a8ec624ab88743a80a38c1b3ac 2023-11-13 04:53:35,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-13 04:53:35,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(777): Region bounds: first= last= 2023-11-13 04:53:35,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HRegion(2446): Flush status journal for e04c69bd7378d342c6ee08c3af87ad84: 2023-11-13 04:53:35,368 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/db193535f0a5448a8250dd18f2a4ead5 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/db193535f0a5448a8250dd18f2a4ead5 2023-11-13 04:53:35,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/da9107d1e809426d8be4c1c75715b517 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__flr34hcqlvc1qrm2f08o05nfvppsj31gq9qloifiut5rpj9lho7fhqc0lkfsf3q5/family1/da9107d1e809426d8be4c1c75715b517 2023-11-13 04:53:35,371 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/cfc5109194f64beebcef4dc3f0b98992 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/cfc5109194f64beebcef4dc3f0b98992 2023-11-13 04:53:35,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__flr34hcqlvc1qrm2f08o05nfvppsj31gq9qloifiut5rpj9lho7fhqc0lkfsf3q5/family1/da9107d1e809426d8be4c1c75715b517 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/9dc3d1a3b29a4c079e030029d703488a_SeqId_47_ 2023-11-13 04:53:35,373 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/fded408177404dbe87fb5f2db0c7dc38 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/fded408177404dbe87fb5f2db0c7dc38 2023-11-13 04:53:35,374 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(849): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__flr34hcqlvc1qrm2f08o05nfvppsj31gq9qloifiut5rpj9lho7fhqc0lkfsf3q5/family1/da9107d1e809426d8be4c1c75715b517 into e04c69bd7378d342c6ee08c3af87ad84/family1 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/9dc3d1a3b29a4c079e030029d703488a_SeqId_47_ - updating store file list. 2023-11-13 04:53:35,376 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/5b9c937f07cd4049b7039d8b47126125 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/5b9c937f07cd4049b7039d8b47126125 2023-11-13 04:53:35,378 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/4869625383bc4818a5c6d47ff862efd6_SeqId_44_ to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/4869625383bc4818a5c6d47ff862efd6_SeqId_44_ 2023-11-13 04:53:35,392 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(882): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/9dc3d1a3b29a4c079e030029d703488a_SeqId_47_ into e04c69bd7378d342c6ee08c3af87ad84/family1 2023-11-13 04:53:35,392 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(855): Successfully loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__flr34hcqlvc1qrm2f08o05nfvppsj31gq9qloifiut5rpj9lho7fhqc0lkfsf3q5/family1/da9107d1e809426d8be4c1c75715b517 into e04c69bd7378d342c6ee08c3af87ad84/family1 (new location: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/9dc3d1a3b29a4c079e030029d703488a_SeqId_47_) 2023-11-13 04:53:35,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__flr34hcqlvc1qrm2f08o05nfvppsj31gq9qloifiut5rpj9lho7fhqc0lkfsf3q5/family1/da9107d1e809426d8be4c1c75715b517 2023-11-13 04:53:35,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-13 04:53:35,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-13 04:53:35,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(1912): e04c69bd7378d342c6ee08c3af87ad84/family1 is initiating minor compaction (all files) 2023-11-13 04:53:35,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6e2b6db0; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-13 04:53:35,396 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of e04c69bd7378d342c6ee08c3af87ad84/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84. 2023-11-13 04:53:35,396 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/c52a69a7a171406687d971b396f1d23d, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/101d9fbc72814c7091d7a9c54bafeb09, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/9dc3d1a3b29a4c079e030029d703488a_SeqId_47_] into tmpdir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/.tmp, totalSize=358.6 K 2023-11-13 04:53:35,397 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting c52a69a7a171406687d971b396f1d23d, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878824229 2023-11-13 04:53:35,397 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 101d9fbc72814c7091d7a9c54bafeb09, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621224229 2023-11-13 04:53:35,398 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 9dc3d1a3b29a4c079e030029d703488a_SeqId_47_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878824229 2023-11-13 04:53:35,403 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-13 04:53:35,405 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:53:35,409 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130d846ebfb87374e2eab82c19caf01eb74 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130d846ebfb87374e2eab82c19caf01eb74 2023-11-13 04:53:35,412 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201c22048dca56b499d9f1ebef90aaa2d70 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201c22048dca56b499d9f1ebef90aaa2d70 2023-11-13 04:53:35,417 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205256850a2fa804ab1ba1f4bd10e880edb to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205256850a2fa804ab1ba1f4bd10e880edb 2023-11-13 04:53:35,417 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-11-13 04:53:35,417 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-13 04:53:35,419 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-13 04:53:35,419 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-13 04:53:35,419 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-13 04:53:35,421 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-13 04:53:35,424 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 1.6750 sec 2023-11-13 04:53:35,457 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] throttle.PressureAwareThroughputController(145): e04c69bd7378d342c6ee08c3af87ad84#family1#compaction#11 average throughput is 3.93 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-13 04:53:35,668 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-13 04:53:35,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure2.ProcedureExecutor(1028): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:35,693 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-11-13 04:53:35,695 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-11-13 04:53:35,695 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-11-13 04:53:35,699 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-11-13 04:53:35,714 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=e04c69bd7378d342c6ee08c3af87ad84, REOPEN/MOVE}] 2023-11-13 04:53:35,715 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=e04c69bd7378d342c6ee08c3af87ad84, REOPEN/MOVE 2023-11-13 04:53:35,716 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=e04c69bd7378d342c6ee08c3af87ad84, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:35,717 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1699851215716"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699851215716"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699851215716"}]},"ts":"1699851215716"} 2023-11-13 04:53:35,719 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure e04c69bd7378d342c6ee08c3af87ad84, server=jenkins-hbase4.apache.org,41657,1699851201532}] 2023-11-13 04:53:35,876 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:35,878 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e04c69bd7378d342c6ee08c3af87ad84 2023-11-13 04:53:35,879 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e04c69bd7378d342c6ee08c3af87ad84, disabling compactions & flushes 2023-11-13 04:53:35,879 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84. 2023-11-13 04:53:35,936 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/.tmp/family1/d76c88a303d048a4a2ae52a7a00d68da as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/d76c88a303d048a4a2ae52a7a00d68da 2023-11-13 04:53:35,942 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in e04c69bd7378d342c6ee08c3af87ad84/family1 of e04c69bd7378d342c6ee08c3af87ad84 into d76c88a303d048a4a2ae52a7a00d68da(size=177.2 K), total size for store is 177.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-13 04:53:35,943 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for e04c69bd7378d342c6ee08c3af87ad84: 2023-11-13 04:53:35,943 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84. 2023-11-13 04:53:35,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84. 2023-11-13 04:53:35,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84. after waiting 0 ms 2023-11-13 04:53:35,943 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84., storeName=family1, fileCount=3, fileSize=358.6 K (175.8 K, 6.6 K, 176.2 K), priority=2, time=1699851215395; duration=0sec 2023-11-13 04:53:35,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84. 2023-11-13 04:53:35,943 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-13 04:53:35,946 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/c52a69a7a171406687d971b396f1d23d, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/101d9fbc72814c7091d7a9c54bafeb09, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/9dc3d1a3b29a4c079e030029d703488a_SeqId_47_] to archive 2023-11-13 04:53:35,947 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:53:35,950 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/c52a69a7a171406687d971b396f1d23d to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/c52a69a7a171406687d971b396f1d23d 2023-11-13 04:53:35,952 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/101d9fbc72814c7091d7a9c54bafeb09 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/101d9fbc72814c7091d7a9c54bafeb09 2023-11-13 04:53:35,954 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/9dc3d1a3b29a4c079e030029d703488a_SeqId_47_ to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/9dc3d1a3b29a4c079e030029d703488a_SeqId_47_ 2023-11-13 04:53:35,959 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-13 04:53:35,960 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84. 2023-11-13 04:53:35,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e04c69bd7378d342c6ee08c3af87ad84: 2023-11-13 04:53:35,960 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: e04c69bd7378d342c6ee08c3af87ad84 to self. 2023-11-13 04:53:35,963 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e04c69bd7378d342c6ee08c3af87ad84 2023-11-13 04:53:35,963 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=e04c69bd7378d342c6ee08c3af87ad84, regionState=CLOSED 2023-11-13 04:53:35,963 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1699851215963"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699851215963"}]},"ts":"1699851215963"} 2023-11-13 04:53:35,967 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=15 2023-11-13 04:53:35,967 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure e04c69bd7378d342c6ee08c3af87ad84, server=jenkins-hbase4.apache.org,41657,1699851201532 in 246 msec 2023-11-13 04:53:35,968 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=e04c69bd7378d342c6ee08c3af87ad84, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,41657,1699851201532; forceNewPlan=false, retain=true 2023-11-13 04:53:36,118 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=e04c69bd7378d342c6ee08c3af87ad84, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:36,119 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1699851216118"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699851216118"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699851216118"}]},"ts":"1699851216118"} 2023-11-13 04:53:36,121 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure e04c69bd7378d342c6ee08c3af87ad84, server=jenkins-hbase4.apache.org,41657,1699851201532}] 2023-11-13 04:53:36,273 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:36,277 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84. 2023-11-13 04:53:36,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e04c69bd7378d342c6ee08c3af87ad84, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84.', STARTKEY => '', ENDKEY => ''} 2023-11-13 04:53:36,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly e04c69bd7378d342c6ee08c3af87ad84 2023-11-13 04:53:36,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-13 04:53:36,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e04c69bd7378d342c6ee08c3af87ad84 2023-11-13 04:53:36,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e04c69bd7378d342c6ee08c3af87ad84 2023-11-13 04:53:36,279 INFO [StoreOpener-e04c69bd7378d342c6ee08c3af87ad84-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e04c69bd7378d342c6ee08c3af87ad84 2023-11-13 04:53:36,281 DEBUG [StoreOpener-e04c69bd7378d342c6ee08c3af87ad84-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1 2023-11-13 04:53:36,281 DEBUG [StoreOpener-e04c69bd7378d342c6ee08c3af87ad84-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1 2023-11-13 04:53:36,281 INFO [StoreOpener-e04c69bd7378d342c6ee08c3af87ad84-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e04c69bd7378d342c6ee08c3af87ad84 columnFamilyName family1 2023-11-13 04:53:36,289 DEBUG [StoreOpener-e04c69bd7378d342c6ee08c3af87ad84-1] regionserver.HStore(539): loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/d76c88a303d048a4a2ae52a7a00d68da 2023-11-13 04:53:36,290 INFO [StoreOpener-e04c69bd7378d342c6ee08c3af87ad84-1] regionserver.HStore(310): Store=e04c69bd7378d342c6ee08c3af87ad84/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-13 04:53:36,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84 2023-11-13 04:53:36,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84 2023-11-13 04:53:36,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e04c69bd7378d342c6ee08c3af87ad84 2023-11-13 04:53:36,297 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e04c69bd7378d342c6ee08c3af87ad84; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73338985, jitterRate=0.09283603727817535}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-13 04:53:36,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e04c69bd7378d342c6ee08c3af87ad84: 2023-11-13 04:53:36,298 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84., pid=17, masterSystemTime=1699851216273 2023-11-13 04:53:36,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84. 2023-11-13 04:53:36,300 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84. 2023-11-13 04:53:36,301 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=e04c69bd7378d342c6ee08c3af87ad84, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:36,301 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1699851216301"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699851216301"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699851216301"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699851216301"}]},"ts":"1699851216301"} 2023-11-13 04:53:36,305 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=17, resume processing ppid=15 2023-11-13 04:53:36,305 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure e04c69bd7378d342c6ee08c3af87ad84, server=jenkins-hbase4.apache.org,41657,1699851201532 in 182 msec 2023-11-13 04:53:36,308 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=14 2023-11-13 04:53:36,308 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=e04c69bd7378d342c6ee08c3af87ad84, REOPEN/MOVE in 591 msec 2023-11-13 04:53:36,311 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=14, resume processing ppid=13 2023-11-13 04:53:36,311 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 611 msec 2023-11-13 04:53:36,314 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 641 msec 2023-11-13 04:53:36,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=13 2023-11-13 04:53:36,325 INFO [Listener at localhost/34517] compactions.TestMobCompactor(278): alter status finished 2023-11-13 04:53:36,326 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33831] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-13 04:53:36,328 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-13 04:53:36,329 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-13 04:53:36,330 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-13 04:53:36,330 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699851816330 2023-11-13 04:53:36,331 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-13 04:53:36,332 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-11-13 04:53:36,332 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-13 04:53:36,334 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] zookeeper.ReadOnlyZKClient(139): Connect 0x7f21c565 to 127.0.0.1:51072 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-13 04:53:36,341 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@19d7bd75, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-13 04:53:36,341 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-13 04:53:36,341 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-13 04:53:36,341 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-13 04:53:36,341 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-13 04:53:36,341 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-13 04:53:37,184 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511283febb172165a46ce8578f63297381ea9 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511283febb172165a46ce8578f63297381ea9 2023-11-13 04:53:37,185 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-13 04:53:37,200 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-13 04:53:37,201 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37442, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-13 04:53:37,223 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-13 04:53:37,226 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43188, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-13 04:53:37,240 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/bb24f578b45d41afacd982594796e4cb first=Optional[r05] last=Optional[r8] 2023-11-13 04:53:37,241 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84., hostname=jenkins-hbase4.apache.org,41657,1699851201532, seqNum=51 for row with hfile group [{family1,hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/bb24f578b45d41afacd982594796e4cb}] 2023-11-13 04:53:37,247 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(763): Validating hfile at hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/bb24f578b45d41afacd982594796e4cb for inclusion in e04c69bd7378d342c6ee08c3af87ad84/family1 2023-11-13 04:53:37,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-13 04:53:37,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(777): Region bounds: first= last= 2023-11-13 04:53:37,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HRegion(2446): Flush status journal for e04c69bd7378d342c6ee08c3af87ad84: 2023-11-13 04:53:37,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/bb24f578b45d41afacd982594796e4cb to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__keliv5kshn9sa7hmumijfm51qaboj0l267i6jof5ep4ffa81dn8u4to5l8fqbl76/family1/bb24f578b45d41afacd982594796e4cb 2023-11-13 04:53:37,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__keliv5kshn9sa7hmumijfm51qaboj0l267i6jof5ep4ffa81dn8u4to5l8fqbl76/family1/bb24f578b45d41afacd982594796e4cb as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/c9a9292835fd4603bc3155cdc6dffd95_SeqId_53_ 2023-11-13 04:53:37,257 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(849): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__keliv5kshn9sa7hmumijfm51qaboj0l267i6jof5ep4ffa81dn8u4to5l8fqbl76/family1/bb24f578b45d41afacd982594796e4cb into e04c69bd7378d342c6ee08c3af87ad84/family1 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/c9a9292835fd4603bc3155cdc6dffd95_SeqId_53_ - updating store file list. 2023-11-13 04:53:37,263 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(882): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/c9a9292835fd4603bc3155cdc6dffd95_SeqId_53_ into e04c69bd7378d342c6ee08c3af87ad84/family1 2023-11-13 04:53:37,264 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(855): Successfully loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__keliv5kshn9sa7hmumijfm51qaboj0l267i6jof5ep4ffa81dn8u4to5l8fqbl76/family1/bb24f578b45d41afacd982594796e4cb into e04c69bd7378d342c6ee08c3af87ad84/family1 (new location: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/family1/c9a9292835fd4603bc3155cdc6dffd95_SeqId_53_) 2023-11-13 04:53:37,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__keliv5kshn9sa7hmumijfm51qaboj0l267i6jof5ep4ffa81dn8u4to5l8fqbl76/family1/bb24f578b45d41afacd982594796e4cb 2023-11-13 04:53:37,267 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-13 04:53:37,268 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:53:37,270 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112057013be41c1f457da37acc38a1e8a050 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112057013be41c1f457da37acc38a1e8a050 2023-11-13 04:53:37,272 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112892c50c77ee6b4d06aa4fd3d097209f5f to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112892c50c77ee6b4d06aa4fd3d097209f5f 2023-11-13 04:53:37,272 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-11-13 04:53:37,272 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-13 04:53:37,273 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-13 04:53:37,273 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-13 04:53:37,273 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-13 04:53:37,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-13 04:53:37,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-13 04:53:37,274 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-13 04:53:37,276 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 947 msec 2023-11-13 04:53:37,376 INFO [Listener at localhost/34517] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=252 (was 215) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:51072@0x7f21c565-SendThread(127.0.0.1:51072) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1289) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c16da608-f133-6e06-11cc-7a1f39f7083b/cluster_96bef9f4-be45-971b-7755-f6017f1a70ff/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:51072@0x586dde8d sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$88/119440339.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:51072@0x586dde8d-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:549) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1643468906_17 at /127.0.0.1:37296 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-637337763_17 at /127.0.0.1:37342 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7654e7-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1643468906_17 at /127.0.0.1:37264 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1643468906_17 at /127.0.0.1:37362 [Waiting for operation #26] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:51072@0x586dde8d-SendThread(127.0.0.1:51072) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1289) Potentially hanging thread: RS:0;jenkins-hbase4:41657-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1643468906_17 at /127.0.0.1:37328 [Waiting for operation #16] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:51072@0x7f21c565 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$88/119440339.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x236ac6b-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1643468906_17 at /127.0.0.1:39258 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1643468906_17 at /127.0.0.1:37358 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1643468906_17 at /127.0.0.1:37440 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:316) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:373) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1643468906_17 at /127.0.0.1:37456 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1643468906_17 at /127.0.0.1:37278 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1643468906_17 at /127.0.0.1:37324 [Waiting for operation #16] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1643468906_17 at /127.0.0.1:37462 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7654e7-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x236ac6b-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c16da608-f133-6e06-11cc-7a1f39f7083b/cluster_96bef9f4-be45-971b-7755-f6017f1a70ff/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1643468906_17 at /127.0.0.1:37412 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1643468906_17 at /127.0.0.1:37402 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1643468906_17 at /127.0.0.1:37392 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x236ac6b-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:51072@0x7f21c565-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:549) - Thread LEAK? -, OpenFileDescriptor=627 (was 505) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=268 (was 250) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=2886 (was 3246) 2023-11-13 04:53:37,391 INFO [Listener at localhost/34517] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=252, OpenFileDescriptor=627, MaxFileDescriptor=60000, SystemLoadAverage=268, ProcessCount=169, AvailableMemoryMB=2884 2023-11-13 04:53:37,393 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-13 04:53:37,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:37,396 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-13 04:53:37,396 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-11-13 04:53:37,397 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-13 04:53:37,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-13 04:53:37,398 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa 2023-11-13 04:53:37,399 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa empty. 2023-11-13 04:53:37,399 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa 2023-11-13 04:53:37,399 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-11-13 04:53:37,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-13 04:53:37,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-13 04:53:37,810 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-13 04:53:37,811 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => e238262ff621754c018596b9ec849ffa, NAME => 'testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp 2023-11-13 04:53:38,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-13 04:53:38,219 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-13 04:53:38,219 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing e238262ff621754c018596b9ec849ffa, disabling compactions & flushes 2023-11-13 04:53:38,219 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa. 2023-11-13 04:53:38,219 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa. 2023-11-13 04:53:38,219 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa. after waiting 0 ms 2023-11-13 04:53:38,219 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa. 2023-11-13 04:53:38,219 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa. 2023-11-13 04:53:38,219 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for e238262ff621754c018596b9ec849ffa: 2023-11-13 04:53:38,223 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-13 04:53:38,224 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1699851218223"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699851218223"}]},"ts":"1699851218223"} 2023-11-13 04:53:38,226 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-13 04:53:38,227 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-13 04:53:38,227 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699851218227"}]},"ts":"1699851218227"} 2023-11-13 04:53:38,228 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-11-13 04:53:38,231 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=e238262ff621754c018596b9ec849ffa, ASSIGN}] 2023-11-13 04:53:38,233 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=e238262ff621754c018596b9ec849ffa, ASSIGN 2023-11-13 04:53:38,234 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=e238262ff621754c018596b9ec849ffa, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41657,1699851201532; forceNewPlan=false, retain=false 2023-11-13 04:53:38,385 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=e238262ff621754c018596b9ec849ffa, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:38,385 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1699851218384"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699851218384"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699851218384"}]},"ts":"1699851218384"} 2023-11-13 04:53:38,387 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure e238262ff621754c018596b9ec849ffa, server=jenkins-hbase4.apache.org,41657,1699851201532}] 2023-11-13 04:53:38,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-13 04:53:38,539 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:38,542 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa. 2023-11-13 04:53:38,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e238262ff621754c018596b9ec849ffa, NAME => 'testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa.', STARTKEY => '', ENDKEY => ''} 2023-11-13 04:53:38,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy e238262ff621754c018596b9ec849ffa 2023-11-13 04:53:38,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-13 04:53:38,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e238262ff621754c018596b9ec849ffa 2023-11-13 04:53:38,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e238262ff621754c018596b9ec849ffa 2023-11-13 04:53:38,544 INFO [StoreOpener-e238262ff621754c018596b9ec849ffa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e238262ff621754c018596b9ec849ffa 2023-11-13 04:53:38,545 DEBUG [StoreOpener-e238262ff621754c018596b9ec849ffa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1 2023-11-13 04:53:38,546 DEBUG [StoreOpener-e238262ff621754c018596b9ec849ffa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1 2023-11-13 04:53:38,546 INFO [StoreOpener-e238262ff621754c018596b9ec849ffa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e238262ff621754c018596b9ec849ffa columnFamilyName family1 2023-11-13 04:53:38,548 INFO [StoreOpener-e238262ff621754c018596b9ec849ffa-1] regionserver.HStore(310): Store=e238262ff621754c018596b9ec849ffa/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-13 04:53:38,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa 2023-11-13 04:53:38,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa 2023-11-13 04:53:38,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e238262ff621754c018596b9ec849ffa 2023-11-13 04:53:38,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-13 04:53:38,556 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e238262ff621754c018596b9ec849ffa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67283026, jitterRate=0.0025952160358428955}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-13 04:53:38,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e238262ff621754c018596b9ec849ffa: 2023-11-13 04:53:38,557 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa., pid=21, masterSystemTime=1699851218539 2023-11-13 04:53:38,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa. 2023-11-13 04:53:38,559 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa. 2023-11-13 04:53:38,559 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=e238262ff621754c018596b9ec849ffa, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:38,560 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1699851218559"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699851218559"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699851218559"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699851218559"}]},"ts":"1699851218559"} 2023-11-13 04:53:38,564 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=21, resume processing ppid=20 2023-11-13 04:53:38,564 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure e238262ff621754c018596b9ec849ffa, server=jenkins-hbase4.apache.org,41657,1699851201532 in 174 msec 2023-11-13 04:53:38,566 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=20, resume processing ppid=19 2023-11-13 04:53:38,566 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=e238262ff621754c018596b9ec849ffa, ASSIGN in 333 msec 2023-11-13 04:53:38,566 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-13 04:53:38,567 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699851218567"}]},"ts":"1699851218567"} 2023-11-13 04:53:38,568 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-11-13 04:53:38,571 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-13 04:53:38,572 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 1.1780 sec 2023-11-13 04:53:39,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-13 04:53:39,503 INFO [Listener at localhost/34517] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-11-13 04:53:39,540 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:53:39,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:39,543 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-13 04:53:39,543 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:39,543 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-13 04:53:39,543 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-13 04:53:39,544 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:39,544 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:39,547 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:39,547 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:39,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:39,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:39,547 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:39,547 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:53:39,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:39,548 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:39,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:53:39,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:39,549 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:39,549 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:39,549 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-13 04:53:39,549 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:39,550 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-13 04:53:39,550 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:53:39,550 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:53:39,550 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa. 2023-11-13 04:53:39,550 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa. started... 2023-11-13 04:53:39,551 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e238262ff621754c018596b9ec849ffa 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-13 04:53:39,978 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130b48ae0ce46e748e3ace436d14ef52d75 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130b48ae0ce46e748e3ace436d14ef52d75 2023-11-13 04:53:40,383 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/.tmp/family1/513e22acc3454676ad14599fd1436f01 2023-11-13 04:53:40,392 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/.tmp/family1/513e22acc3454676ad14599fd1436f01 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/513e22acc3454676ad14599fd1436f01 2023-11-13 04:53:40,398 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/513e22acc3454676ad14599fd1436f01, entries=1000, sequenceid=5, filesize=166.0 K 2023-11-13 04:53:40,400 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for e238262ff621754c018596b9ec849ffa in 850ms, sequenceid=5, compaction requested=false 2023-11-13 04:53:40,400 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-11-13 04:53:40,401 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e238262ff621754c018596b9ec849ffa: 2023-11-13 04:53:40,401 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa. 2023-11-13 04:53:40,401 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:53:40,401 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:53:40,401 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:40,401 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-13 04:53:40,401 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-13 04:53:40,403 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:40,403 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:40,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:40,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:40,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:40,403 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:40,403 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:53:40,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:40,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:40,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:40,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:40,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:40,406 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-13 04:53:40,407 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@507bb6ed[Count = 0] remaining members to acquire global barrier 2023-11-13 04:53:40,407 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-13 04:53:40,407 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:40,408 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:40,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:40,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:40,408 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-13 04:53:40,409 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-13 04:53:40,409 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:53:40,409 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:40,409 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:53:40,410 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:40,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:40,410 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-13 04:53:40,411 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:40,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:40,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:40,411 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-13 04:53:40,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:40,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:40,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:40,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:40,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:40,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:40,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:40,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:53:40,415 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-13 04:53:40,415 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-13 04:53:40,415 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:53:40,415 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:53:40,415 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:40,415 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:53:40,417 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:40,417 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:40,417 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:40,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:40,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:40,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:40,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:40,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:40,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:40,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:40,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:40,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:40,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:40,422 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:40,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:40,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:40,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:40,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:40,424 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:40,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:40,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:40,435 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:40,435 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:40,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:40,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:40,435 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:40,435 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-13 04:53:40,435 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:53:40,435 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:40,435 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:40,435 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:40,436 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:40,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:40,436 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:40,436 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-13 04:53:40,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:40,437 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:53:40,436 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:40,437 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:40,537 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:53:40,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:53:40,543 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:53:40,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-13 04:53:40,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:40,545 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-13 04:53:40,545 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:40,546 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-13 04:53:40,546 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-13 04:53:40,546 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:40,547 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:40,548 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:40,548 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:40,548 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:40,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:40,549 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:40,549 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:53:40,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:40,549 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:40,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:53:40,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:40,550 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:40,550 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-13 04:53:40,550 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:40,550 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-13 04:53:40,550 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:40,551 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-13 04:53:40,551 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:53:40,551 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:53:40,551 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa. 2023-11-13 04:53:40,551 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa. started... 2023-11-13 04:53:40,551 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e238262ff621754c018596b9ec849ffa 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-13 04:53:40,967 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511280073d7decc594224b51e5b0a0bd90c20 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511280073d7decc594224b51e5b0a0bd90c20 2023-11-13 04:53:41,373 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/.tmp/family1/8cc0538f5526477ca322f75d2a012c8b 2023-11-13 04:53:41,380 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/.tmp/family1/8cc0538f5526477ca322f75d2a012c8b as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/8cc0538f5526477ca322f75d2a012c8b 2023-11-13 04:53:41,385 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/8cc0538f5526477ca322f75d2a012c8b, entries=1, sequenceid=9, filesize=5.0 K 2023-11-13 04:53:41,387 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for e238262ff621754c018596b9ec849ffa in 836ms, sequenceid=9, compaction requested=false 2023-11-13 04:53:41,387 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e238262ff621754c018596b9ec849ffa: 2023-11-13 04:53:41,387 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa. 2023-11-13 04:53:41,387 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:53:41,387 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:53:41,387 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:41,387 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-13 04:53:41,387 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-13 04:53:41,389 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,389 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:41,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:41,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:41,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:41,389 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,390 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:53:41,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:41,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:41,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:41,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:41,391 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-13 04:53:41,391 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b44678d[Count = 0] remaining members to acquire global barrier 2023-11-13 04:53:41,391 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-13 04:53:41,391 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,393 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,394 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-13 04:53:41,394 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-13 04:53:41,394 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:53:41,394 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:41,394 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:53:41,395 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:41,395 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-13 04:53:41,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:41,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:41,395 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:41,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:41,396 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-13 04:53:41,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:41,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:41,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:41,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:41,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:41,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:53:41,399 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-13 04:53:41,399 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-13 04:53:41,399 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:53:41,399 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:53:41,399 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,399 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:53:41,401 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,401 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:41,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:41,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,401 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:41,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:41,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:41,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:41,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,402 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:41,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:41,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:41,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:41,404 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:41,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:41,406 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:41,406 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,406 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:41,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:41,406 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:41,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:41,407 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,407 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:41,407 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-13 04:53:41,407 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:53:41,407 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,407 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:41,407 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,407 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,408 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-13 04:53:41,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:41,408 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:53:41,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:41,500 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-13 04:53:41,508 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:53:41,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:53:41,515 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:53:41,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-13 04:53:41,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,517 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-13 04:53:41,517 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:41,517 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-13 04:53:41,517 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-13 04:53:41,518 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,518 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,521 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:41,521 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:41,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:41,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:41,521 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:41,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,521 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:53:41,522 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:53:41,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,522 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,522 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-13 04:53:41,522 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,523 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-13 04:53:41,523 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:41,523 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-13 04:53:41,523 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:53:41,523 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:53:41,523 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa. 2023-11-13 04:53:41,523 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa. started... 2023-11-13 04:53:41,524 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e238262ff621754c018596b9ec849ffa 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:53:41,542 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120108dcbefb8c73485ab04170f35ebf154e to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120108dcbefb8c73485ab04170f35ebf154e 2023-11-13 04:53:41,948 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/.tmp/family1/80310f291ad64071b9502d3d0f6f2007 2023-11-13 04:53:41,956 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/.tmp/family1/80310f291ad64071b9502d3d0f6f2007 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/80310f291ad64071b9502d3d0f6f2007 2023-11-13 04:53:41,961 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/80310f291ad64071b9502d3d0f6f2007, entries=1, sequenceid=13, filesize=4.9 K 2023-11-13 04:53:41,962 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e238262ff621754c018596b9ec849ffa in 438ms, sequenceid=13, compaction requested=true 2023-11-13 04:53:41,962 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e238262ff621754c018596b9ec849ffa: 2023-11-13 04:53:41,962 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa. 2023-11-13 04:53:41,962 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:53:41,963 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:53:41,963 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:41,963 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-13 04:53:41,963 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-13 04:53:41,965 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:41,965 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:41,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:41,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:41,965 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,965 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:53:41,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:41,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:41,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:41,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:41,967 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-13 04:53:41,967 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@674a6bb2[Count = 0] remaining members to acquire global barrier 2023-11-13 04:53:41,967 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-13 04:53:41,967 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,969 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,969 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-13 04:53:41,969 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-13 04:53:41,969 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:53:41,969 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:41,969 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:53:41,971 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:41,971 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-13 04:53:41,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:41,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:41,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:41,971 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:41,971 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-13 04:53:41,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:41,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:41,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:41,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:41,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:41,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:53:41,975 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-13 04:53:41,975 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-13 04:53:41,975 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:53:41,975 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:53:41,975 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,975 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:53:41,978 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,978 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,978 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:41,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:41,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:41,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:41,978 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:41,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:41,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:41,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:41,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,980 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:41,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:41,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:41,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:41,983 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:41,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:41,983 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:41,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:41,983 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:41,983 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:41,983 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-13 04:53:41,983 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-13 04:53:41,984 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:53:41,983 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,984 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,984 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:41,984 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,984 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,984 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:41,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:41,984 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-13 04:53:41,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:41,985 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:53:42,085 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:53:42,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:53:42,091 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:53:42,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-13 04:53:42,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:42,093 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-13 04:53:42,093 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:42,093 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-13 04:53:42,093 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-13 04:53:42,094 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:42,094 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:42,095 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:42,095 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:42,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:42,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:42,096 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:42,096 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:53:42,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:42,096 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:42,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:53:42,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:42,097 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:42,097 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-13 04:53:42,097 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:42,097 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-13 04:53:42,097 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:42,097 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-13 04:53:42,098 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:53:42,098 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:53:42,098 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa. 2023-11-13 04:53:42,098 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa. started... 2023-11-13 04:53:42,098 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e238262ff621754c018596b9ec849ffa 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:53:42,512 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120530deeaaa6acd45acab5a866c31daf125 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120530deeaaa6acd45acab5a866c31daf125 2023-11-13 04:53:42,919 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/.tmp/family1/29bf761217ea4c68a25abe3cee7af3ce 2023-11-13 04:53:42,925 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/.tmp/family1/29bf761217ea4c68a25abe3cee7af3ce as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/29bf761217ea4c68a25abe3cee7af3ce 2023-11-13 04:53:42,930 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/29bf761217ea4c68a25abe3cee7af3ce, entries=1, sequenceid=17, filesize=4.9 K 2023-11-13 04:53:42,932 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e238262ff621754c018596b9ec849ffa in 834ms, sequenceid=17, compaction requested=true 2023-11-13 04:53:42,932 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e238262ff621754c018596b9ec849ffa: 2023-11-13 04:53:42,932 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa. 2023-11-13 04:53:42,932 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:53:42,932 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:53:42,932 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:42,932 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-13 04:53:42,932 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-13 04:53:42,934 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:42,934 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:42,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:42,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:42,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:42,935 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:42,935 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:53:42,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:42,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:42,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:42,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:42,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:42,936 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-13 04:53:42,936 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4f31fdb9[Count = 0] remaining members to acquire global barrier 2023-11-13 04:53:42,936 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-13 04:53:42,937 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:42,940 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:42,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:42,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:42,941 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-13 04:53:42,941 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-13 04:53:42,941 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:53:42,941 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:42,941 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:53:42,945 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-13 04:53:42,945 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:42,945 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:42,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:42,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:42,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:42,946 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-13 04:53:42,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:42,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:42,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:42,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:42,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:42,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:42,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:42,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:53:42,948 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-13 04:53:42,948 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-13 04:53:42,948 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:53:42,948 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:53:42,948 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:42,949 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:53:42,950 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:42,950 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:42,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:42,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:42,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:42,951 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:42,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:42,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:42,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:42,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:42,951 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:42,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:42,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:42,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:42,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:42,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:42,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:42,953 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:42,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:42,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:42,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:42,955 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:42,956 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:42,956 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:42,956 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:42,956 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:42,956 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:42,956 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-13 04:53:42,956 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:53:42,956 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:42,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:42,956 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:42,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:42,956 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:42,956 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:42,957 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-13 04:53:42,957 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:53:42,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:42,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:43,057 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:53:43,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:53:43,062 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:53:43,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-13 04:53:43,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:43,064 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-13 04:53:43,064 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:43,065 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-13 04:53:43,065 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-13 04:53:43,065 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:43,065 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:43,067 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:43,067 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:43,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:43,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:43,068 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:43,068 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:53:43,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:43,068 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:43,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:53:43,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:43,069 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:43,069 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-13 04:53:43,069 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:43,069 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-13 04:53:43,069 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:43,070 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-13 04:53:43,070 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:53:43,070 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:53:43,070 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa. 2023-11-13 04:53:43,070 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa. started... 2023-11-13 04:53:43,070 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e238262ff621754c018596b9ec849ffa 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:53:43,092 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122892bb3acdd26c427497f93c71f7fa8551 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015122892bb3acdd26c427497f93c71f7fa8551 2023-11-13 04:53:43,499 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/.tmp/family1/93354b21333447fc816512ab9dbc71e2 2023-11-13 04:53:43,505 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/.tmp/family1/93354b21333447fc816512ab9dbc71e2 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/93354b21333447fc816512ab9dbc71e2 2023-11-13 04:53:43,510 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/93354b21333447fc816512ab9dbc71e2, entries=1, sequenceid=21, filesize=4.9 K 2023-11-13 04:53:43,511 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e238262ff621754c018596b9ec849ffa in 441ms, sequenceid=21, compaction requested=true 2023-11-13 04:53:43,511 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e238262ff621754c018596b9ec849ffa: 2023-11-13 04:53:43,511 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa. 2023-11-13 04:53:43,511 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:53:43,511 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:53:43,511 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:43,511 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-13 04:53:43,511 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-13 04:53:43,513 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:43,513 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:43,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:43,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:43,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:43,513 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:43,513 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:53:43,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:43,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:43,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:43,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:43,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:43,515 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-13 04:53:43,515 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@42f0f66c[Count = 0] remaining members to acquire global barrier 2023-11-13 04:53:43,515 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-13 04:53:43,515 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:43,517 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:43,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:43,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:43,517 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-13 04:53:43,517 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-13 04:53:43,517 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:53:43,517 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:43,517 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:53:43,519 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-13 04:53:43,519 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:43,519 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:43,519 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-13 04:53:43,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:43,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:43,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:43,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:43,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:43,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:43,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:43,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:43,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:43,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:43,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:53:43,527 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-13 04:53:43,527 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-13 04:53:43,527 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:53:43,527 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:53:43,527 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:43,527 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:53:43,530 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:43,530 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:43,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:43,530 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:43,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:43,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:43,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:43,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:43,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:43,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:43,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:43,531 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:43,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:43,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:43,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:43,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:43,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:43,533 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:43,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:43,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:43,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:43,536 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:43,536 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:43,536 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:43,536 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:43,536 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:43,536 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:43,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:43,536 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:43,536 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:43,536 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:43,536 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:43,536 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-13 04:53:43,537 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:53:43,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:43,537 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-13 04:53:43,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:43,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:43,537 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:53:43,638 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:53:43,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:53:43,643 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:53:43,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-13 04:53:43,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:43,645 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-13 04:53:43,645 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:43,646 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-13 04:53:43,646 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-13 04:53:43,646 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:43,646 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:43,648 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:43,648 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:43,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:43,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:43,648 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:43,648 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:53:43,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:43,649 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:43,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:53:43,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:43,650 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:43,650 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-13 04:53:43,650 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:43,650 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-13 04:53:43,650 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:43,651 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-13 04:53:43,651 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:53:43,651 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:53:43,651 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa. 2023-11-13 04:53:43,651 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa. started... 2023-11-13 04:53:43,651 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e238262ff621754c018596b9ec849ffa 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:53:44,075 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231642f4b98e3444ac591113c56851cd968 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231642f4b98e3444ac591113c56851cd968 2023-11-13 04:53:44,483 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/.tmp/family1/a6bf5cc16c6c46fca9d34506f44f0f16 2023-11-13 04:53:44,490 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/.tmp/family1/a6bf5cc16c6c46fca9d34506f44f0f16 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/a6bf5cc16c6c46fca9d34506f44f0f16 2023-11-13 04:53:44,495 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/a6bf5cc16c6c46fca9d34506f44f0f16, entries=1, sequenceid=25, filesize=4.9 K 2023-11-13 04:53:44,496 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e238262ff621754c018596b9ec849ffa in 845ms, sequenceid=25, compaction requested=true 2023-11-13 04:53:44,496 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e238262ff621754c018596b9ec849ffa: 2023-11-13 04:53:44,496 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa. 2023-11-13 04:53:44,496 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:53:44,496 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:53:44,496 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:44,496 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-13 04:53:44,496 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-13 04:53:44,498 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:44,498 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:44,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:44,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:44,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:44,499 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:44,499 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:53:44,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:44,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:44,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:44,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:44,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:44,500 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-13 04:53:44,500 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ab099b0[Count = 0] remaining members to acquire global barrier 2023-11-13 04:53:44,500 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-13 04:53:44,501 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:44,502 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:44,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:44,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:44,502 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-13 04:53:44,502 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-13 04:53:44,502 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:53:44,502 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:44,502 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:53:44,505 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-13 04:53:44,505 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:44,505 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:44,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:44,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:44,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:44,505 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-13 04:53:44,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:44,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:44,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:44,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:44,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:44,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:44,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:44,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:53:44,508 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-13 04:53:44,508 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-13 04:53:44,508 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:53:44,508 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:53:44,509 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:44,509 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:53:44,510 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:44,510 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:44,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:44,510 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:44,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:44,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:44,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:44,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:44,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:44,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:44,511 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:44,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:44,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:44,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:44,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:44,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:44,512 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:44,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:44,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:44,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:44,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:44,515 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:44,515 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:44,515 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:44,515 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:44,515 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:44,515 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:44,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:44,515 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-13 04:53:44,515 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:44,515 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-13 04:53:44,515 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:53:44,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:44,515 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:44,515 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:44,516 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:44,516 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-13 04:53:44,516 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:53:44,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:44,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:44,616 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:53:44,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:53:44,622 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:53:44,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-13 04:53:44,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:44,624 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-13 04:53:44,624 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:44,625 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-13 04:53:44,625 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-13 04:53:44,625 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:44,625 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:44,627 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:44,627 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:44,627 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:44,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:44,627 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:44,627 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:53:44,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:44,628 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:44,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:53:44,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:44,628 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:44,628 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-13 04:53:44,628 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:44,628 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-13 04:53:44,628 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:44,629 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-13 04:53:44,629 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:53:44,629 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:53:44,629 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa. 2023-11-13 04:53:44,629 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa. started... 2023-11-13 04:53:44,629 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e238262ff621754c018596b9ec849ffa 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:53:45,045 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010105a2402acd1a424caa55153cbb78b4aa to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010105a2402acd1a424caa55153cbb78b4aa 2023-11-13 04:53:45,451 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/.tmp/family1/75345070946943d3ba449611ab4f0c02 2023-11-13 04:53:45,457 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/.tmp/family1/75345070946943d3ba449611ab4f0c02 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/75345070946943d3ba449611ab4f0c02 2023-11-13 04:53:45,462 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/75345070946943d3ba449611ab4f0c02, entries=1, sequenceid=29, filesize=4.9 K 2023-11-13 04:53:45,464 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e238262ff621754c018596b9ec849ffa in 835ms, sequenceid=29, compaction requested=true 2023-11-13 04:53:45,464 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e238262ff621754c018596b9ec849ffa: 2023-11-13 04:53:45,464 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa. 2023-11-13 04:53:45,464 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:53:45,464 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:53:45,464 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:45,464 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-13 04:53:45,464 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-13 04:53:45,561 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:45,561 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:45,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:45,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:45,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:45,562 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:45,562 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:53:45,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:45,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:45,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:45,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:45,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:45,563 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-13 04:53:45,563 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4e136aaf[Count = 0] remaining members to acquire global barrier 2023-11-13 04:53:45,563 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-13 04:53:45,564 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:45,605 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:45,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:45,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:45,605 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-13 04:53:45,605 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-13 04:53:45,605 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:53:45,605 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:45,605 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:53:45,651 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:45,651 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-13 04:53:45,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:45,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:45,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:45,651 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:45,651 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-13 04:53:45,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:45,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:45,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:45,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:45,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:45,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:45,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:45,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:53:45,654 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-13 04:53:45,654 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-13 04:53:45,654 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:53:45,654 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:53:45,654 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:45,654 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:53:45,666 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:45,666 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:45,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:45,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:45,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:45,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:45,666 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:45,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:45,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:45,667 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:45,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:45,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:45,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:45,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:45,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:45,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:45,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:45,668 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:45,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:45,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:45,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:45,689 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:45,689 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:45,689 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:45,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:45,689 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-13 04:53:45,689 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:53:45,689 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:45,689 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:45,689 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:45,689 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:45,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:45,690 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-13 04:53:45,690 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:45,690 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:53:45,690 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:45,690 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:45,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:45,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:45,790 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:53:45,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:53:45,797 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:53:45,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-13 04:53:45,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:45,799 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-13 04:53:45,799 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:45,799 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-13 04:53:45,799 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-13 04:53:45,800 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:45,800 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:45,801 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:45,801 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:45,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:45,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:45,802 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:45,802 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:53:45,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:45,802 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:45,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:53:45,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:45,803 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:45,803 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-13 04:53:45,803 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:45,804 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-13 04:53:45,804 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:45,804 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-13 04:53:45,804 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:53:45,804 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:53:45,805 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa. 2023-11-13 04:53:45,805 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa. started... 2023-11-13 04:53:45,805 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e238262ff621754c018596b9ec849ffa 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:53:46,220 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601033991f5b234b840cd8d3be0237935bef1 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601033991f5b234b840cd8d3be0237935bef1 2023-11-13 04:53:46,626 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/.tmp/family1/7af574ac1d2c4418b9ac1ba56b33a3a9 2023-11-13 04:53:46,632 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/.tmp/family1/7af574ac1d2c4418b9ac1ba56b33a3a9 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/7af574ac1d2c4418b9ac1ba56b33a3a9 2023-11-13 04:53:46,638 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/7af574ac1d2c4418b9ac1ba56b33a3a9, entries=1, sequenceid=33, filesize=4.9 K 2023-11-13 04:53:46,639 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e238262ff621754c018596b9ec849ffa in 834ms, sequenceid=33, compaction requested=true 2023-11-13 04:53:46,639 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e238262ff621754c018596b9ec849ffa: 2023-11-13 04:53:46,639 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa. 2023-11-13 04:53:46,639 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:53:46,639 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:53:46,639 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:46,639 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-13 04:53:46,640 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-13 04:53:46,642 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:46,642 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:46,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:46,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:46,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:46,642 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:46,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:46,642 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:53:46,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:46,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:46,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:46,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:46,644 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-13 04:53:46,644 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e8f8ae1[Count = 0] remaining members to acquire global barrier 2023-11-13 04:53:46,644 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-13 04:53:46,644 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:46,646 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:46,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:46,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:46,646 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-13 04:53:46,646 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-13 04:53:46,646 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:53:46,646 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:46,646 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:53:46,648 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-13 04:53:46,648 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:46,648 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:46,648 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-13 04:53:46,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:46,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:46,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:46,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:46,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:46,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:46,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:46,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:46,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:46,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:46,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:53:46,653 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-13 04:53:46,653 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-13 04:53:46,653 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:53:46,653 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:53:46,653 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:46,653 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:53:46,655 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:46,655 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:46,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:46,655 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:46,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:46,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:46,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:46,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:46,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:46,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:46,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:46,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:46,657 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:46,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:46,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:46,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:46,658 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:46,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:46,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:46,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:46,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:46,661 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:46,661 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:46,661 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:46,661 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:46,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:46,662 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:46,662 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:46,662 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:46,662 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:46,662 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:46,662 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:46,662 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-13 04:53:46,662 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:53:46,662 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-13 04:53:46,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:46,663 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-13 04:53:46,663 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:53:46,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:46,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:46,763 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:53:46,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:53:46,769 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:53:46,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-13 04:53:46,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:46,770 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-13 04:53:46,770 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:46,771 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-13 04:53:46,771 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-13 04:53:46,771 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:46,771 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:46,773 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:46,773 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:46,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:46,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:46,773 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:46,774 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:53:46,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:46,774 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:46,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:53:46,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:46,774 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:46,775 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-13 04:53:46,775 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:46,775 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-13 04:53:46,775 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:46,775 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-13 04:53:46,776 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:53:46,776 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:53:46,776 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa. 2023-11-13 04:53:46,776 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa. started... 2023-11-13 04:53:46,776 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e238262ff621754c018596b9ec849ffa 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:53:47,227 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090739cbe3f5cae443e4a0983188e366ffe9 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015090739cbe3f5cae443e4a0983188e366ffe9 2023-11-13 04:53:47,233 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/.tmp/family1/b9a74997ca9b4d178f79636e3a292ab3 2023-11-13 04:53:47,240 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/.tmp/family1/b9a74997ca9b4d178f79636e3a292ab3 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/b9a74997ca9b4d178f79636e3a292ab3 2023-11-13 04:53:47,247 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/b9a74997ca9b4d178f79636e3a292ab3, entries=1, sequenceid=37, filesize=4.9 K 2023-11-13 04:53:47,249 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e238262ff621754c018596b9ec849ffa in 473ms, sequenceid=37, compaction requested=true 2023-11-13 04:53:47,249 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e238262ff621754c018596b9ec849ffa: 2023-11-13 04:53:47,249 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa. 2023-11-13 04:53:47,249 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:53:47,249 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:53:47,249 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:47,249 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-13 04:53:47,249 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-13 04:53:47,253 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:47,253 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:47,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:47,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:47,254 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,254 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:53:47,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:47,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:47,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:47,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:47,256 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-13 04:53:47,256 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b895eca[Count = 0] remaining members to acquire global barrier 2023-11-13 04:53:47,256 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-13 04:53:47,256 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,257 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,257 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-13 04:53:47,258 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-13 04:53:47,258 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:53:47,258 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:47,258 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:53:47,263 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:47,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:47,263 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-13 04:53:47,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:47,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:47,263 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:47,264 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-13 04:53:47,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:47,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:47,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:47,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:47,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:47,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:53:47,268 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-13 04:53:47,268 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-13 04:53:47,268 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:53:47,268 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:53:47,268 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,269 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:53:47,271 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,271 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,271 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:47,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:47,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:47,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:47,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:47,272 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:47,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:47,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:47,274 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:47,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:47,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:47,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:47,280 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:47,280 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:47,280 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,281 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,281 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:47,281 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:47,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:47,281 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:47,281 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,281 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-13 04:53:47,281 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:53:47,281 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:47,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:47,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:47,282 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-13 04:53:47,281 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,282 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:53:47,282 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-13 04:53:47,382 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:53:47,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:53:47,388 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:53:47,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-13 04:53:47,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,390 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-13 04:53:47,390 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:47,391 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-13 04:53:47,391 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-13 04:53:47,391 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,391 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,393 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:47,393 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:47,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:47,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:47,394 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:47,394 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:53:47,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,394 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:53:47,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,395 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,395 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-13 04:53:47,395 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,395 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-13 04:53:47,395 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:47,397 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-13 04:53:47,397 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:53:47,397 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:53:47,397 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa. 2023-11-13 04:53:47,397 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa. started... 2023-11-13 04:53:47,397 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e238262ff621754c018596b9ec849ffa 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:53:47,420 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120e994ecabfcaf4538a0176b8c99e74635 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120e994ecabfcaf4538a0176b8c99e74635 2023-11-13 04:53:47,827 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/.tmp/family1/91adb6fc4c1445388bad4d40173d4465 2023-11-13 04:53:47,833 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/.tmp/family1/91adb6fc4c1445388bad4d40173d4465 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/91adb6fc4c1445388bad4d40173d4465 2023-11-13 04:53:47,838 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/91adb6fc4c1445388bad4d40173d4465, entries=1, sequenceid=41, filesize=4.9 K 2023-11-13 04:53:47,839 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e238262ff621754c018596b9ec849ffa in 442ms, sequenceid=41, compaction requested=true 2023-11-13 04:53:47,839 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e238262ff621754c018596b9ec849ffa: 2023-11-13 04:53:47,839 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa. 2023-11-13 04:53:47,839 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:53:47,839 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:53:47,840 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:47,840 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-13 04:53:47,840 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-13 04:53:47,841 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:47,841 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:47,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:47,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:47,842 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,842 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:53:47,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:47,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:47,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:47,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:47,843 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-13 04:53:47,843 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@358a3312[Count = 0] remaining members to acquire global barrier 2023-11-13 04:53:47,843 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-13 04:53:47,843 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,844 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,845 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-13 04:53:47,845 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-13 04:53:47,845 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:53:47,845 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:47,845 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:53:47,848 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:47,848 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-13 04:53:47,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:47,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:47,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:47,848 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:47,848 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-13 04:53:47,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:47,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:47,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:47,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:47,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:47,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:53:47,851 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-13 04:53:47,851 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-13 04:53:47,851 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:53:47,851 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:53:47,851 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,851 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:53:47,852 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,852 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:47,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:47,853 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:47,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:47,853 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:47,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:47,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:47,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:47,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:47,854 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:47,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:47,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:47,857 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:47,857 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,857 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,857 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:47,857 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:47,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:47,857 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:47,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:47,857 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-13 04:53:47,858 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:53:47,857 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:47,857 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,859 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,859 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,859 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-13 04:53:47,859 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:53:47,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:47,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:47,959 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:53:47,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:53:47,962 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33831] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-11-13 04:53:47,964 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] procedure2.ProcedureExecutor(1028): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-13 04:53:47,964 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-13 04:53:47,965 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-13 04:53:47,965 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699851827965 2023-11-13 04:53:47,967 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-13 04:53:47,968 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-11-13 04:53:47,968 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-13 04:53:47,970 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] zookeeper.ReadOnlyZKClient(139): Connect 0x2de998e1 to 127.0.0.1:51072 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-13 04:53:47,976 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@971a43c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-13 04:53:47,976 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-13 04:53:48,414 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010347863546d850466895e32ab303d39396 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010347863546d850466895e32ab303d39396 2023-11-13 04:53:48,415 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-13 04:53:48,428 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-13 04:53:48,429 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55344, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-13 04:53:48,435 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-13 04:53:48,436 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47488, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-13 04:53:48,445 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/e853a76c827645288857e2a5cad400c4 first=Optional[r5] last=Optional[r6] 2023-11-13 04:53:48,446 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa., hostname=jenkins-hbase4.apache.org,41657,1699851201532, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/e853a76c827645288857e2a5cad400c4}] 2023-11-13 04:53:48,450 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(763): Validating hfile at hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/e853a76c827645288857e2a5cad400c4 for inclusion in e238262ff621754c018596b9ec849ffa/family1 2023-11-13 04:53:48,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-11-13 04:53:48,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(777): Region bounds: first= last= 2023-11-13 04:53:48,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HRegion(2446): Flush status journal for e238262ff621754c018596b9ec849ffa: 2023-11-13 04:53:48,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/e853a76c827645288857e2a5cad400c4 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithMonthlyPolicy__224qdjtepaav6li5bsfj58vsh4rgcpsn07sd7tdhliche6qsqtl2pgasl0d42plq/family1/e853a76c827645288857e2a5cad400c4 2023-11-13 04:53:48,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithMonthlyPolicy__224qdjtepaav6li5bsfj58vsh4rgcpsn07sd7tdhliche6qsqtl2pgasl0d42plq/family1/e853a76c827645288857e2a5cad400c4 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/eb7549998e4346e8940cfb6b9d135cd8_SeqId_44_ 2023-11-13 04:53:48,456 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(849): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithMonthlyPolicy__224qdjtepaav6li5bsfj58vsh4rgcpsn07sd7tdhliche6qsqtl2pgasl0d42plq/family1/e853a76c827645288857e2a5cad400c4 into e238262ff621754c018596b9ec849ffa/family1 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/eb7549998e4346e8940cfb6b9d135cd8_SeqId_44_ - updating store file list. 2023-11-13 04:53:48,461 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(882): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/eb7549998e4346e8940cfb6b9d135cd8_SeqId_44_ into e238262ff621754c018596b9ec849ffa/family1 2023-11-13 04:53:48,462 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(855): Successfully loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithMonthlyPolicy__224qdjtepaav6li5bsfj58vsh4rgcpsn07sd7tdhliche6qsqtl2pgasl0d42plq/family1/e853a76c827645288857e2a5cad400c4 into e238262ff621754c018596b9ec849ffa/family1 (new location: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/eb7549998e4346e8940cfb6b9d135cd8_SeqId_44_) 2023-11-13 04:53:48,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithMonthlyPolicy__224qdjtepaav6li5bsfj58vsh4rgcpsn07sd7tdhliche6qsqtl2pgasl0d42plq/family1/e853a76c827645288857e2a5cad400c4 2023-11-13 04:53:48,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-13 04:53:48,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-13 04:53:48,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(1912): e238262ff621754c018596b9ec849ffa/family1 is initiating minor compaction 2023-11-13 04:53:48,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@68cab249; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-13 04:53:48,469 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of e238262ff621754c018596b9ec849ffa/family1 in testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa. 2023-11-13 04:53:48,469 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/8cc0538f5526477ca322f75d2a012c8b, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/80310f291ad64071b9502d3d0f6f2007, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/29bf761217ea4c68a25abe3cee7af3ce, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/93354b21333447fc816512ab9dbc71e2, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/a6bf5cc16c6c46fca9d34506f44f0f16, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/75345070946943d3ba449611ab4f0c02, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/7af574ac1d2c4418b9ac1ba56b33a3a9, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/b9a74997ca9b4d178f79636e3a292ab3, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/91adb6fc4c1445388bad4d40173d4465, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/eb7549998e4346e8940cfb6b9d135cd8_SeqId_44_] into tmpdir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/.tmp, totalSize=49.7 K 2023-11-13 04:53:48,469 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 8cc0538f5526477ca322f75d2a012c8b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-13 04:53:48,469 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 80310f291ad64071b9502d3d0f6f2007, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-13 04:53:48,469 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 29bf761217ea4c68a25abe3cee7af3ce, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-13 04:53:48,469 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 93354b21333447fc816512ab9dbc71e2, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-13 04:53:48,469 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting a6bf5cc16c6c46fca9d34506f44f0f16, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-13 04:53:48,469 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 75345070946943d3ba449611ab4f0c02, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-13 04:53:48,469 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 7af574ac1d2c4418b9ac1ba56b33a3a9, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-13 04:53:48,470 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting b9a74997ca9b4d178f79636e3a292ab3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-13 04:53:48,470 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 91adb6fc4c1445388bad4d40173d4465, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-13 04:53:48,470 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting eb7549998e4346e8940cfb6b9d135cd8_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-13 04:53:48,472 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-13 04:53:48,475 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:53:48,478 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010105a2402acd1a424caa55153cbb78b4aa to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010105a2402acd1a424caa55153cbb78b4aa 2023-11-13 04:53:48,479 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601033991f5b234b840cd8d3be0237935bef1 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601033991f5b234b840cd8d3be0237935bef1 2023-11-13 04:53:48,479 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-11-13 04:53:48,479 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-11-13 04:53:48,480 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-13 04:53:48,480 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-13 04:53:48,518 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] throttle.PressureAwareThroughputController(145): e238262ff621754c018596b9ec849ffa#family1#compaction#22 average throughput is 0.46 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-13 04:53:49,346 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/.tmp/family1/8ba5e082fa3d4b2b83ad8f1dc73bdd35 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/8ba5e082fa3d4b2b83ad8f1dc73bdd35 2023-11-13 04:53:49,353 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in e238262ff621754c018596b9ec849ffa/family1 of e238262ff621754c018596b9ec849ffa into 8ba5e082fa3d4b2b83ad8f1dc73bdd35(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-13 04:53:49,353 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for e238262ff621754c018596b9ec849ffa: 2023-11-13 04:53:49,354 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1699851228468; duration=0sec 2023-11-13 04:53:49,354 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-13 04:53:49,356 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231647bb4912eb14bc3a271fe827c03221c to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231647bb4912eb14bc3a271fe827c03221c 2023-11-13 04:53:49,357 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-13 04:53:49,390 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/430f39b153104aa2bbe93f33bc0d659b first=Optional[r1] last=Optional[r4] 2023-11-13 04:53:49,390 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa., hostname=jenkins-hbase4.apache.org,41657,1699851201532, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/430f39b153104aa2bbe93f33bc0d659b}] 2023-11-13 04:53:49,392 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(763): Validating hfile at hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/430f39b153104aa2bbe93f33bc0d659b for inclusion in e238262ff621754c018596b9ec849ffa/family1 2023-11-13 04:53:49,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-11-13 04:53:49,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(777): Region bounds: first= last= 2023-11-13 04:53:49,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HRegion(2446): Flush status journal for e238262ff621754c018596b9ec849ffa: 2023-11-13 04:53:49,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/430f39b153104aa2bbe93f33bc0d659b to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithMonthlyPolicy__lqbktqb2rg7of39lga740ekfjt0recm22adlitt7ulhf5oscf72hen3640qrkdbs/family1/430f39b153104aa2bbe93f33bc0d659b 2023-11-13 04:53:49,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithMonthlyPolicy__lqbktqb2rg7of39lga740ekfjt0recm22adlitt7ulhf5oscf72hen3640qrkdbs/family1/430f39b153104aa2bbe93f33bc0d659b as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/68de4f40fba44d2696bb66dd7924a42a_SeqId_47_ 2023-11-13 04:53:49,400 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(849): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithMonthlyPolicy__lqbktqb2rg7of39lga740ekfjt0recm22adlitt7ulhf5oscf72hen3640qrkdbs/family1/430f39b153104aa2bbe93f33bc0d659b into e238262ff621754c018596b9ec849ffa/family1 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/68de4f40fba44d2696bb66dd7924a42a_SeqId_47_ - updating store file list. 2023-11-13 04:53:49,404 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(882): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/68de4f40fba44d2696bb66dd7924a42a_SeqId_47_ into e238262ff621754c018596b9ec849ffa/family1 2023-11-13 04:53:49,404 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(855): Successfully loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithMonthlyPolicy__lqbktqb2rg7of39lga740ekfjt0recm22adlitt7ulhf5oscf72hen3640qrkdbs/family1/430f39b153104aa2bbe93f33bc0d659b into e238262ff621754c018596b9ec849ffa/family1 (new location: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/68de4f40fba44d2696bb66dd7924a42a_SeqId_47_) 2023-11-13 04:53:49,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithMonthlyPolicy__lqbktqb2rg7of39lga740ekfjt0recm22adlitt7ulhf5oscf72hen3640qrkdbs/family1/430f39b153104aa2bbe93f33bc0d659b 2023-11-13 04:53:49,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-13 04:53:49,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-13 04:53:49,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(1912): e238262ff621754c018596b9ec849ffa/family1 is initiating minor compaction (all files) 2023-11-13 04:53:49,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@182595d2; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-13 04:53:49,406 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of e238262ff621754c018596b9ec849ffa/family1 in testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa. 2023-11-13 04:53:49,406 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/513e22acc3454676ad14599fd1436f01, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/8ba5e082fa3d4b2b83ad8f1dc73bdd35, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/68de4f40fba44d2696bb66dd7924a42a_SeqId_47_] into tmpdir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/.tmp, totalSize=178.1 K 2023-11-13 04:53:49,407 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 513e22acc3454676ad14599fd1436f01, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878824229 2023-11-13 04:53:49,407 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 8ba5e082fa3d4b2b83ad8f1dc73bdd35, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621224229 2023-11-13 04:53:49,408 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 68de4f40fba44d2696bb66dd7924a42a_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965224229 2023-11-13 04:53:49,408 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-13 04:53:49,409 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:53:49,411 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120108dcbefb8c73485ab04170f35ebf154e to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120108dcbefb8c73485ab04170f35ebf154e 2023-11-13 04:53:49,412 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120530deeaaa6acd45acab5a866c31daf125 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120530deeaaa6acd45acab5a866c31daf125 2023-11-13 04:53:49,414 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015122892bb3acdd26c427497f93c71f7fa8551 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015122892bb3acdd26c427497f93c71f7fa8551 2023-11-13 04:53:49,415 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231642f4b98e3444ac591113c56851cd968 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231642f4b98e3444ac591113c56851cd968 2023-11-13 04:53:49,415 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-11-13 04:53:49,415 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-11-13 04:53:49,416 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-13 04:53:49,416 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-13 04:53:49,433 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] throttle.PressureAwareThroughputController(145): e238262ff621754c018596b9ec849ffa#family1#compaction#23 average throughput is 10.37 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-13 04:53:49,453 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/8cc0538f5526477ca322f75d2a012c8b, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/80310f291ad64071b9502d3d0f6f2007, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/29bf761217ea4c68a25abe3cee7af3ce, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/93354b21333447fc816512ab9dbc71e2, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/a6bf5cc16c6c46fca9d34506f44f0f16, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/75345070946943d3ba449611ab4f0c02, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/7af574ac1d2c4418b9ac1ba56b33a3a9, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/b9a74997ca9b4d178f79636e3a292ab3, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/91adb6fc4c1445388bad4d40173d4465, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/eb7549998e4346e8940cfb6b9d135cd8_SeqId_44_] to archive 2023-11-13 04:53:49,454 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:53:49,456 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/8cc0538f5526477ca322f75d2a012c8b to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/8cc0538f5526477ca322f75d2a012c8b 2023-11-13 04:53:49,459 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/80310f291ad64071b9502d3d0f6f2007 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/80310f291ad64071b9502d3d0f6f2007 2023-11-13 04:53:49,464 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/29bf761217ea4c68a25abe3cee7af3ce to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/29bf761217ea4c68a25abe3cee7af3ce 2023-11-13 04:53:49,466 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/93354b21333447fc816512ab9dbc71e2 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/93354b21333447fc816512ab9dbc71e2 2023-11-13 04:53:49,470 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/a6bf5cc16c6c46fca9d34506f44f0f16 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/a6bf5cc16c6c46fca9d34506f44f0f16 2023-11-13 04:53:49,472 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/75345070946943d3ba449611ab4f0c02 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/75345070946943d3ba449611ab4f0c02 2023-11-13 04:53:49,480 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/7af574ac1d2c4418b9ac1ba56b33a3a9 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/7af574ac1d2c4418b9ac1ba56b33a3a9 2023-11-13 04:53:49,483 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/b9a74997ca9b4d178f79636e3a292ab3 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/b9a74997ca9b4d178f79636e3a292ab3 2023-11-13 04:53:49,488 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/91adb6fc4c1445388bad4d40173d4465 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/91adb6fc4c1445388bad4d40173d4465 2023-11-13 04:53:49,490 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/eb7549998e4346e8940cfb6b9d135cd8_SeqId_44_ to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/eb7549998e4346e8940cfb6b9d135cd8_SeqId_44_ 2023-11-13 04:53:49,519 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/.tmp/family1/7b1c5fd136934a969af9fea73b51c099 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/7b1c5fd136934a969af9fea73b51c099 2023-11-13 04:53:49,527 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in e238262ff621754c018596b9ec849ffa/family1 of e238262ff621754c018596b9ec849ffa into 7b1c5fd136934a969af9fea73b51c099(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-13 04:53:49,527 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for e238262ff621754c018596b9ec849ffa: 2023-11-13 04:53:49,527 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1699851229406; duration=0sec 2023-11-13 04:53:49,527 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-13 04:53:49,538 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/513e22acc3454676ad14599fd1436f01, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/8ba5e082fa3d4b2b83ad8f1dc73bdd35, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/68de4f40fba44d2696bb66dd7924a42a_SeqId_47_] to archive 2023-11-13 04:53:49,539 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:53:49,541 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/513e22acc3454676ad14599fd1436f01 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/513e22acc3454676ad14599fd1436f01 2023-11-13 04:53:49,542 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/8ba5e082fa3d4b2b83ad8f1dc73bdd35 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/8ba5e082fa3d4b2b83ad8f1dc73bdd35 2023-11-13 04:53:49,544 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/68de4f40fba44d2696bb66dd7924a42a_SeqId_47_ to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/68de4f40fba44d2696bb66dd7924a42a_SeqId_47_ 2023-11-13 04:53:50,326 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113029bc98b46d5542229b43b5e06534662c to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015113029bc98b46d5542229b43b5e06534662c 2023-11-13 04:53:50,327 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-13 04:53:50,359 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/329bb9170a414f198b4e554a11862e7b first=Optional[r00] last=Optional[r8] 2023-11-13 04:53:50,359 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa., hostname=jenkins-hbase4.apache.org,41657,1699851201532, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/329bb9170a414f198b4e554a11862e7b}] 2023-11-13 04:53:50,362 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(763): Validating hfile at hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/329bb9170a414f198b4e554a11862e7b for inclusion in e238262ff621754c018596b9ec849ffa/family1 2023-11-13 04:53:50,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-11-13 04:53:50,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(777): Region bounds: first= last= 2023-11-13 04:53:50,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HRegion(2446): Flush status journal for e238262ff621754c018596b9ec849ffa: 2023-11-13 04:53:50,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/329bb9170a414f198b4e554a11862e7b to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithMonthlyPolicy__41lmb2nc0k0fpb8npkcciem4n013nevv2sbpvds7aj9id4vpbmsbk7fp0obpdda3/family1/329bb9170a414f198b4e554a11862e7b 2023-11-13 04:53:50,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithMonthlyPolicy__41lmb2nc0k0fpb8npkcciem4n013nevv2sbpvds7aj9id4vpbmsbk7fp0obpdda3/family1/329bb9170a414f198b4e554a11862e7b as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/3a3fc3555dbb425885fdcb6e002da460_SeqId_50_ 2023-11-13 04:53:50,369 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(849): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithMonthlyPolicy__41lmb2nc0k0fpb8npkcciem4n013nevv2sbpvds7aj9id4vpbmsbk7fp0obpdda3/family1/329bb9170a414f198b4e554a11862e7b into e238262ff621754c018596b9ec849ffa/family1 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/3a3fc3555dbb425885fdcb6e002da460_SeqId_50_ - updating store file list. 2023-11-13 04:53:50,374 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(882): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/3a3fc3555dbb425885fdcb6e002da460_SeqId_50_ into e238262ff621754c018596b9ec849ffa/family1 2023-11-13 04:53:50,374 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(855): Successfully loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithMonthlyPolicy__41lmb2nc0k0fpb8npkcciem4n013nevv2sbpvds7aj9id4vpbmsbk7fp0obpdda3/family1/329bb9170a414f198b4e554a11862e7b into e238262ff621754c018596b9ec849ffa/family1 (new location: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/family1/3a3fc3555dbb425885fdcb6e002da460_SeqId_50_) 2023-11-13 04:53:50,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithMonthlyPolicy__41lmb2nc0k0fpb8npkcciem4n013nevv2sbpvds7aj9id4vpbmsbk7fp0obpdda3/family1/329bb9170a414f198b4e554a11862e7b 2023-11-13 04:53:50,377 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-13 04:53:50,377 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:53:50,379 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120e994ecabfcaf4538a0176b8c99e74635 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120e994ecabfcaf4538a0176b8c99e74635 2023-11-13 04:53:50,380 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511280073d7decc594224b51e5b0a0bd90c20 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511280073d7decc594224b51e5b0a0bd90c20 2023-11-13 04:53:50,381 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130b48ae0ce46e748e3ace436d14ef52d75 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130b48ae0ce46e748e3ace436d14ef52d75 2023-11-13 04:53:50,382 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-11-13 04:53:50,382 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-13 04:53:50,382 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-13 04:53:50,382 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-13 04:53:50,382 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-13 04:53:50,382 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-13 04:53:50,382 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-13 04:53:50,383 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-13 04:53:50,385 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.4200 sec 2023-11-13 04:53:50,518 INFO [Listener at localhost/34517] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=259 (was 252) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1643468906_17 at /127.0.0.1:33008 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3e13048d-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3e13048d-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:51072@0x2de998e1-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:549) Potentially hanging thread: hconnection-0x3e13048d-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1643468906_17 at /127.0.0.1:33330 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1643468906_17 at /127.0.0.1:33326 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1643468906_17 at /127.0.0.1:33180 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1643468906_17 at /127.0.0.1:33248 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1643468906_17 at /127.0.0.1:33114 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1643468906_17 at /127.0.0.1:33154 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3e13048d-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-637337763_17 at /127.0.0.1:33050 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3e13048d-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:51072@0x2de998e1-SendThread(127.0.0.1:51072) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1289) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1643468906_17 at /127.0.0.1:33146 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1643468906_17 at /127.0.0.1:32984 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1643468906_17 at /127.0.0.1:33062 [Waiting for operation #17] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1643468906_17 at /127.0.0.1:33130 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-637337763_17 at /127.0.0.1:33166 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1643468906_17 at /127.0.0.1:33096 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3e13048d-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1643468906_17 at /127.0.0.1:32936 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3e13048d-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1643468906_17 at /127.0.0.1:33038 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1643468906_17 at /127.0.0.1:33100 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:51072@0x2de998e1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$88/119440339.run(Unknown Source) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=642 (was 627) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=235 (was 268), ProcessCount=169 (was 169), AvailableMemoryMB=2737 (was 2884) 2023-11-13 04:53:50,531 INFO [Listener at localhost/34517] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=259, OpenFileDescriptor=642, MaxFileDescriptor=60000, SystemLoadAverage=235, ProcessCount=169, AvailableMemoryMB=2736 2023-11-13 04:53:50,533 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-13 04:53:50,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure2.ProcedureExecutor(1028): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:50,536 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-13 04:53:50,536 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-11-13 04:53:50,536 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-13 04:53:50,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-13 04:53:50,538 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e 2023-11-13 04:53:50,539 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e empty. 2023-11-13 04:53:50,539 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e 2023-11-13 04:53:50,539 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-11-13 04:53:50,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-13 04:53:50,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-13 04:53:50,951 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-13 04:53:50,953 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 27cb223f9866bdc4989cc22b2513873e, NAME => 'testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp 2023-11-13 04:53:51,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-13 04:53:51,359 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-13 04:53:51,359 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing 27cb223f9866bdc4989cc22b2513873e, disabling compactions & flushes 2023-11-13 04:53:51,359 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e. 2023-11-13 04:53:51,359 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e. 2023-11-13 04:53:51,359 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e. after waiting 0 ms 2023-11-13 04:53:51,359 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e. 2023-11-13 04:53:51,360 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e. 2023-11-13 04:53:51,360 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 27cb223f9866bdc4989cc22b2513873e: 2023-11-13 04:53:51,362 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-13 04:53:51,363 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1699851231363"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699851231363"}]},"ts":"1699851231363"} 2023-11-13 04:53:51,365 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-13 04:53:51,366 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-13 04:53:51,366 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699851231366"}]},"ts":"1699851231366"} 2023-11-13 04:53:51,367 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-11-13 04:53:51,371 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=27cb223f9866bdc4989cc22b2513873e, ASSIGN}] 2023-11-13 04:53:51,372 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=27cb223f9866bdc4989cc22b2513873e, ASSIGN 2023-11-13 04:53:51,373 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=27cb223f9866bdc4989cc22b2513873e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41657,1699851201532; forceNewPlan=false, retain=false 2023-11-13 04:53:51,524 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=27cb223f9866bdc4989cc22b2513873e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:51,524 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1699851231524"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699851231524"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699851231524"}]},"ts":"1699851231524"} 2023-11-13 04:53:51,526 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure 27cb223f9866bdc4989cc22b2513873e, server=jenkins-hbase4.apache.org,41657,1699851201532}] 2023-11-13 04:53:51,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-13 04:53:51,678 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:51,682 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e. 2023-11-13 04:53:51,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 27cb223f9866bdc4989cc22b2513873e, NAME => 'testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e.', STARTKEY => '', ENDKEY => ''} 2023-11-13 04:53:51,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy 27cb223f9866bdc4989cc22b2513873e 2023-11-13 04:53:51,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-13 04:53:51,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 27cb223f9866bdc4989cc22b2513873e 2023-11-13 04:53:51,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 27cb223f9866bdc4989cc22b2513873e 2023-11-13 04:53:51,684 INFO [StoreOpener-27cb223f9866bdc4989cc22b2513873e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 27cb223f9866bdc4989cc22b2513873e 2023-11-13 04:53:51,686 DEBUG [StoreOpener-27cb223f9866bdc4989cc22b2513873e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1 2023-11-13 04:53:51,686 DEBUG [StoreOpener-27cb223f9866bdc4989cc22b2513873e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1 2023-11-13 04:53:51,686 INFO [StoreOpener-27cb223f9866bdc4989cc22b2513873e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 27cb223f9866bdc4989cc22b2513873e columnFamilyName family1 2023-11-13 04:53:51,688 INFO [StoreOpener-27cb223f9866bdc4989cc22b2513873e-1] regionserver.HStore(310): Store=27cb223f9866bdc4989cc22b2513873e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-13 04:53:51,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e 2023-11-13 04:53:51,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e 2023-11-13 04:53:51,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 27cb223f9866bdc4989cc22b2513873e 2023-11-13 04:53:51,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-13 04:53:51,695 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 27cb223f9866bdc4989cc22b2513873e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73208867, jitterRate=0.09089712798595428}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-13 04:53:51,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 27cb223f9866bdc4989cc22b2513873e: 2023-11-13 04:53:51,696 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e., pid=25, masterSystemTime=1699851231678 2023-11-13 04:53:51,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e. 2023-11-13 04:53:51,698 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e. 2023-11-13 04:53:51,699 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=27cb223f9866bdc4989cc22b2513873e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:51,699 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1699851231699"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699851231699"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699851231699"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699851231699"}]},"ts":"1699851231699"} 2023-11-13 04:53:51,702 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=24 2023-11-13 04:53:51,703 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure 27cb223f9866bdc4989cc22b2513873e, server=jenkins-hbase4.apache.org,41657,1699851201532 in 175 msec 2023-11-13 04:53:51,704 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=23 2023-11-13 04:53:51,704 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=27cb223f9866bdc4989cc22b2513873e, ASSIGN in 332 msec 2023-11-13 04:53:51,705 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-13 04:53:51,705 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699851231705"}]},"ts":"1699851231705"} 2023-11-13 04:53:51,706 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-11-13 04:53:51,709 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-13 04:53:51,710 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 1.1760 sec 2023-11-13 04:53:52,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-13 04:53:52,642 INFO [Listener at localhost/34517] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-11-13 04:53:52,673 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:53:52,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:52,674 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-13 04:53:52,674 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:52,674 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-13 04:53:52,675 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-13 04:53:52,675 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:52,675 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:52,678 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:52,678 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:52,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:52,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:52,678 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:52,678 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:53:52,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:52,678 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:52,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:53:52,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:52,679 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:52,679 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:52,679 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-13 04:53:52,679 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:52,679 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-13 04:53:52,680 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:53:52,680 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:53:52,680 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e. 2023-11-13 04:53:52,680 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e. started... 2023-11-13 04:53:52,681 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 27cb223f9866bdc4989cc22b2513873e 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-13 04:53:52,704 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130073e78c80a764491a35056f1d8825a97 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151130073e78c80a764491a35056f1d8825a97 2023-11-13 04:53:52,833 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-11-13 04:53:53,108 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/.tmp/family1/04e6892e6c5b43138d3dd83dd60e3e8f 2023-11-13 04:53:53,114 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/.tmp/family1/04e6892e6c5b43138d3dd83dd60e3e8f as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/04e6892e6c5b43138d3dd83dd60e3e8f 2023-11-13 04:53:53,119 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/04e6892e6c5b43138d3dd83dd60e3e8f, entries=1000, sequenceid=5, filesize=165.1 K 2023-11-13 04:53:53,120 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 27cb223f9866bdc4989cc22b2513873e in 440ms, sequenceid=5, compaction requested=false 2023-11-13 04:53:53,121 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 27cb223f9866bdc4989cc22b2513873e: 2023-11-13 04:53:53,121 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e. 2023-11-13 04:53:53,121 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:53:53,121 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:53:53,121 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:53,121 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-13 04:53:53,121 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-13 04:53:53,123 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:53,123 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:53,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:53,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:53,123 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,123 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:53:53,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:53,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:53,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:53,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:53,125 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-13 04:53:53,125 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6019611e[Count = 0] remaining members to acquire global barrier 2023-11-13 04:53:53,125 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-13 04:53:53,125 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,126 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,126 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-13 04:53:53,127 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-13 04:53:53,127 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:53:53,127 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:53,127 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:53:53,128 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-13 04:53:53,128 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:53,128 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:53,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:53,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:53,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:53,128 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-13 04:53:53,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:53,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:53,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:53,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:53,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:53,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:53:53,131 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-13 04:53:53,131 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-13 04:53:53,131 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:53:53,131 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:53:53,131 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,131 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:53:53,134 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,134 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:53,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:53,134 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:53,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:53,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:53,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:53,135 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:53,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:53,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:53,136 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:53,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:53,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:53,139 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:53,139 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:53,139 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,139 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:53,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:53,139 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:53,139 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-13 04:53:53,139 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:53:53,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:53,139 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,140 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:53,140 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,140 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,140 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,140 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-13 04:53:53,140 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:53:53,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:53,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:53,240 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:53:53,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:53:53,245 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:53:53,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-13 04:53:53,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,247 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-13 04:53:53,247 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:53,247 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-13 04:53:53,247 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-13 04:53:53,247 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,247 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,249 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:53,249 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:53,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:53,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:53,249 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:53,249 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:53:53,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,250 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:53:53,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,250 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,251 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-13 04:53:53,251 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,251 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-13 04:53:53,251 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:53,251 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-13 04:53:53,251 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:53:53,251 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:53:53,251 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e. 2023-11-13 04:53:53,251 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e. started... 2023-11-13 04:53:53,251 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 27cb223f9866bdc4989cc22b2513873e 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-13 04:53:53,668 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128245d68e463ac486082c2d68ba31bfa24 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151128245d68e463ac486082c2d68ba31bfa24 2023-11-13 04:53:53,674 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/.tmp/family1/1a03324977f2479996acf8c7831bce1f 2023-11-13 04:53:53,679 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/.tmp/family1/1a03324977f2479996acf8c7831bce1f as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/1a03324977f2479996acf8c7831bce1f 2023-11-13 04:53:53,684 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/1a03324977f2479996acf8c7831bce1f, entries=1, sequenceid=9, filesize=5.0 K 2023-11-13 04:53:53,685 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 27cb223f9866bdc4989cc22b2513873e in 434ms, sequenceid=9, compaction requested=false 2023-11-13 04:53:53,685 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 27cb223f9866bdc4989cc22b2513873e: 2023-11-13 04:53:53,685 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e. 2023-11-13 04:53:53,685 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:53:53,685 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:53:53,685 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:53,686 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-13 04:53:53,686 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-13 04:53:53,692 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:53,692 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:53,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:53,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:53,693 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:53,693 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:53:53,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:53,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:53,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:53,694 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-13 04:53:53,694 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12b3277e[Count = 0] remaining members to acquire global barrier 2023-11-13 04:53:53,694 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-13 04:53:53,694 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,696 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,696 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-13 04:53:53,696 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-13 04:53:53,696 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:53:53,696 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:53,696 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:53:53,698 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-13 04:53:53,698 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:53,698 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:53,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:53,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:53,698 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-13 04:53:53,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:53,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:53,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:53,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:53,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:53,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:53,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:53:53,700 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-13 04:53:53,700 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-13 04:53:53,700 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:53:53,700 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:53:53,700 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,701 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:53:53,702 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,702 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,702 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:53,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:53,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:53,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:53,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:53,703 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:53,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:53,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:53,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,704 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:53,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:53,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:53,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:53,712 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:53,713 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,713 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:53,713 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,713 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:53,713 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-13 04:53:53,713 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:53:53,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:53,713 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-13 04:53:53,713 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:53,713 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:53,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:53,713 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-13 04:53:53,713 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:53:53,713 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,713 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,713 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:53,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:53,813 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:53:53,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:53:53,819 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:53:53,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-13 04:53:53,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,820 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-13 04:53:53,820 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:53,820 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-13 04:53:53,820 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-13 04:53:53,821 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,821 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,822 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:53,822 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:53,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:53,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:53,823 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:53,823 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:53:53,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,823 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:53:53,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,824 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,824 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-13 04:53:53,824 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:53,824 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-13 04:53:53,824 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:53,824 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-13 04:53:53,824 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:53:53,824 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:53:53,824 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e. 2023-11-13 04:53:53,824 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e. started... 2023-11-13 04:53:53,824 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 27cb223f9866bdc4989cc22b2513873e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:53:54,238 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512012fdee63e9d7f4f168e73a1b67329293a to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512012fdee63e9d7f4f168e73a1b67329293a 2023-11-13 04:53:54,243 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/.tmp/family1/2ebe57fbd5554d43b12efb523f8dcc45 2023-11-13 04:53:54,248 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/.tmp/family1/2ebe57fbd5554d43b12efb523f8dcc45 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/2ebe57fbd5554d43b12efb523f8dcc45 2023-11-13 04:53:54,253 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/2ebe57fbd5554d43b12efb523f8dcc45, entries=1, sequenceid=13, filesize=4.9 K 2023-11-13 04:53:54,254 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 27cb223f9866bdc4989cc22b2513873e in 430ms, sequenceid=13, compaction requested=true 2023-11-13 04:53:54,254 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 27cb223f9866bdc4989cc22b2513873e: 2023-11-13 04:53:54,254 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e. 2023-11-13 04:53:54,254 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:53:54,254 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:53:54,254 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:54,254 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-13 04:53:54,254 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-13 04:53:54,256 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:54,256 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:54,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:54,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:54,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:54,256 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:54,256 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:53:54,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:54,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:54,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:54,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:54,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:54,258 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-13 04:53:54,258 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@13cd44ec[Count = 0] remaining members to acquire global barrier 2023-11-13 04:53:54,258 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-13 04:53:54,258 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:54,259 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:54,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:54,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:54,259 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-13 04:53:54,259 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-13 04:53:54,259 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:54,259 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:53:54,259 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:53:54,262 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-13 04:53:54,262 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:54,262 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:54,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:54,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:54,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:54,262 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-13 04:53:54,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:54,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:54,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:54,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:54,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:54,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:54,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:54,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:53:54,264 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-13 04:53:54,264 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-13 04:53:54,264 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:53:54,264 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:53:54,264 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:54,264 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:53:54,266 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:54,266 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:54,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:54,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:54,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:54,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:54,266 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:54,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:54,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:54,266 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:54,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:54,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:54,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:54,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:54,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:54,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:54,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:54,268 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:54,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:54,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:54,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:54,270 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:54,270 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:54,270 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:54,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:54,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:54,270 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-13 04:53:54,270 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:53:54,270 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:54,270 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:54,270 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:54,270 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:54,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:54,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:54,271 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-13 04:53:54,270 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:54,271 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:53:54,271 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:54,271 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:54,371 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:53:54,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:53:54,376 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:53:54,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-13 04:53:54,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:54,378 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-13 04:53:54,378 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:54,378 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-13 04:53:54,378 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-13 04:53:54,378 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:54,378 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:54,380 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:54,380 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:54,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:54,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:54,380 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:54,380 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:53:54,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:54,381 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:54,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:53:54,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:54,381 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:54,381 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-13 04:53:54,382 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:54,382 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-13 04:53:54,382 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:54,382 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-13 04:53:54,382 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:53:54,382 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:53:54,382 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e. 2023-11-13 04:53:54,382 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e. started... 2023-11-13 04:53:54,382 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 27cb223f9866bdc4989cc22b2513873e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:53:54,796 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512051c375daabd4b4dda8034fab0af73a926 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512051c375daabd4b4dda8034fab0af73a926 2023-11-13 04:53:55,203 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/.tmp/family1/ebd23af5a0144a6a9354d58b2bd7ba16 2023-11-13 04:53:55,208 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/.tmp/family1/ebd23af5a0144a6a9354d58b2bd7ba16 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/ebd23af5a0144a6a9354d58b2bd7ba16 2023-11-13 04:53:55,213 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/ebd23af5a0144a6a9354d58b2bd7ba16, entries=1, sequenceid=17, filesize=4.9 K 2023-11-13 04:53:55,214 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 27cb223f9866bdc4989cc22b2513873e in 832ms, sequenceid=17, compaction requested=true 2023-11-13 04:53:55,214 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 27cb223f9866bdc4989cc22b2513873e: 2023-11-13 04:53:55,214 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e. 2023-11-13 04:53:55,214 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:53:55,214 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:53:55,214 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:55,214 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-13 04:53:55,215 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-13 04:53:55,217 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:55,217 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:55,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:55,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:55,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:55,218 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:55,218 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:53:55,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:55,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:55,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:55,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:55,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:55,219 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-13 04:53:55,219 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@77bbe724[Count = 0] remaining members to acquire global barrier 2023-11-13 04:53:55,219 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-13 04:53:55,219 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:55,221 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:55,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:55,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:55,221 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-13 04:53:55,221 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-13 04:53:55,221 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:53:55,221 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:55,221 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:53:55,222 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-13 04:53:55,222 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:55,222 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:55,222 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-13 04:53:55,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:55,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:55,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:55,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:55,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:55,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:55,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:55,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:55,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:55,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:55,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:53:55,225 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-13 04:53:55,225 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-13 04:53:55,225 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:53:55,225 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:53:55,225 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:55,225 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:53:55,227 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:55,227 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:55,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:55,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:55,227 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:55,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:55,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:55,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:55,228 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:55,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:55,228 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:55,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:55,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:55,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:55,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:55,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:55,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:55,229 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:55,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:55,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:55,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:55,240 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:55,240 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:55,240 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:55,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:55,240 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:55,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:55,240 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-13 04:53:55,241 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:53:55,240 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:55,240 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:55,241 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:55,241 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:55,241 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:55,241 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:55,241 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-13 04:53:55,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:55,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:55,241 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:53:55,341 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:53:55,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:53:55,346 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:53:55,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-13 04:53:55,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:55,348 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-13 04:53:55,348 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:55,348 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-13 04:53:55,348 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-13 04:53:55,349 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:55,349 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:55,350 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:55,350 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:55,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:55,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:55,350 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:55,350 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:53:55,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:55,351 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:55,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:53:55,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:55,351 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:55,351 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-13 04:53:55,351 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:55,352 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-13 04:53:55,352 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:55,352 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-13 04:53:55,352 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:53:55,352 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:53:55,352 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e. 2023-11-13 04:53:55,352 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e. started... 2023-11-13 04:53:55,352 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 27cb223f9866bdc4989cc22b2513873e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:53:55,765 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122861dc0cc455144059901e5f9ed8f605e6 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015122861dc0cc455144059901e5f9ed8f605e6 2023-11-13 04:53:56,171 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/.tmp/family1/296c63ced28b4561ac9c73286c8770b6 2023-11-13 04:53:56,177 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/.tmp/family1/296c63ced28b4561ac9c73286c8770b6 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/296c63ced28b4561ac9c73286c8770b6 2023-11-13 04:53:56,182 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/296c63ced28b4561ac9c73286c8770b6, entries=1, sequenceid=21, filesize=4.9 K 2023-11-13 04:53:56,183 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 27cb223f9866bdc4989cc22b2513873e in 831ms, sequenceid=21, compaction requested=true 2023-11-13 04:53:56,183 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 27cb223f9866bdc4989cc22b2513873e: 2023-11-13 04:53:56,183 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e. 2023-11-13 04:53:56,183 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:53:56,183 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:53:56,183 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:56,184 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-13 04:53:56,184 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-13 04:53:56,186 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:56,186 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:56,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:56,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:56,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:56,186 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:56,186 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:53:56,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:56,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:56,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:56,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:56,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:56,187 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-13 04:53:56,188 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c81795c[Count = 0] remaining members to acquire global barrier 2023-11-13 04:53:56,188 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-13 04:53:56,188 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:56,189 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:56,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:56,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:56,189 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-13 04:53:56,189 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-13 04:53:56,189 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:53:56,189 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:56,189 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:53:56,191 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:56,191 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-13 04:53:56,191 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:56,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:56,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:56,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:56,191 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-13 04:53:56,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:56,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:56,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:56,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:56,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:56,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:56,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:56,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:53:56,193 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-13 04:53:56,193 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-13 04:53:56,193 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:53:56,194 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:53:56,194 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:56,194 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:53:56,195 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:56,195 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:56,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:56,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:56,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:56,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:56,195 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:56,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:56,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:56,196 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:56,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:56,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:56,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:56,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:56,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:56,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:56,197 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:56,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:56,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:56,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:56,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:56,200 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:56,200 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:56,200 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:56,200 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:56,200 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:56,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:56,201 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-13 04:53:56,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:56,200 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:56,200 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:56,201 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:56,201 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-13 04:53:56,201 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:53:56,201 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:56,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:56,201 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:56,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:56,201 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-13 04:53:56,201 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:53:56,301 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:53:56,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:53:56,306 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:53:56,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-13 04:53:56,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:56,308 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-13 04:53:56,308 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:56,308 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-13 04:53:56,308 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-13 04:53:56,309 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:56,309 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:56,310 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:56,310 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:56,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:56,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:56,311 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:56,311 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:53:56,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:56,311 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:56,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:53:56,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:56,311 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:56,312 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-13 04:53:56,312 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:56,312 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-13 04:53:56,312 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:56,312 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-13 04:53:56,312 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:53:56,312 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:53:56,312 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e. 2023-11-13 04:53:56,312 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e. started... 2023-11-13 04:53:56,312 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 27cb223f9866bdc4989cc22b2513873e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:53:56,726 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512316ff211de4e65429f9cc04404f3feaf76 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512316ff211de4e65429f9cc04404f3feaf76 2023-11-13 04:53:57,131 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/.tmp/family1/c0cedd511300441b9a80c329b32893d4 2023-11-13 04:53:57,137 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/.tmp/family1/c0cedd511300441b9a80c329b32893d4 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/c0cedd511300441b9a80c329b32893d4 2023-11-13 04:53:57,142 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/c0cedd511300441b9a80c329b32893d4, entries=1, sequenceid=25, filesize=4.9 K 2023-11-13 04:53:57,143 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 27cb223f9866bdc4989cc22b2513873e in 831ms, sequenceid=25, compaction requested=true 2023-11-13 04:53:57,143 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 27cb223f9866bdc4989cc22b2513873e: 2023-11-13 04:53:57,143 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e. 2023-11-13 04:53:57,143 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:53:57,143 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:53:57,143 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:57,143 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-13 04:53:57,143 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-13 04:53:57,145 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:57,145 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:57,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:57,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:57,145 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,146 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:53:57,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:57,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:57,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:57,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:57,147 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-13 04:53:57,147 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-13 04:53:57,147 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@57023d65[Count = 0] remaining members to acquire global barrier 2023-11-13 04:53:57,147 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,149 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,149 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-13 04:53:57,149 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-13 04:53:57,149 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:53:57,149 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:57,149 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:53:57,151 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:57,151 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-13 04:53:57,151 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:57,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:57,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:57,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:57,151 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-13 04:53:57,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:57,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:57,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:57,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:57,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:57,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:53:57,154 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-13 04:53:57,154 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-13 04:53:57,154 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:53:57,154 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:53:57,154 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,154 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:53:57,156 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,156 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:57,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:57,156 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:57,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,157 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:57,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:57,157 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:57,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:57,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:57,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,158 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:57,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:57,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:57,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:57,160 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:57,160 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:57,160 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:57,161 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:57,161 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:57,161 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-13 04:53:57,161 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:53:57,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:57,161 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,161 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:57,161 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,161 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-13 04:53:57,161 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-13 04:53:57,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:57,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:57,161 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,161 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:53:57,161 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,218 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-13 04:53:57,262 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:53:57,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:53:57,267 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:53:57,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-13 04:53:57,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,269 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-13 04:53:57,269 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:57,269 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-13 04:53:57,269 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-13 04:53:57,269 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,269 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,271 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:57,271 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:57,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:57,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:57,271 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:57,271 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:53:57,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,271 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:53:57,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,272 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,272 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-13 04:53:57,272 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,272 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-13 04:53:57,272 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:57,273 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-13 04:53:57,273 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:53:57,273 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:53:57,273 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e. 2023-11-13 04:53:57,273 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e. started... 2023-11-13 04:53:57,273 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 27cb223f9866bdc4989cc22b2513873e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:53:57,287 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010122d106b0c673448eabf4dc6956cfa383 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010122d106b0c673448eabf4dc6956cfa383 2023-11-13 04:53:57,692 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/.tmp/family1/267af44590654b41aabd1ce7c2ce48cf 2023-11-13 04:53:57,697 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/.tmp/family1/267af44590654b41aabd1ce7c2ce48cf as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/267af44590654b41aabd1ce7c2ce48cf 2023-11-13 04:53:57,702 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/267af44590654b41aabd1ce7c2ce48cf, entries=1, sequenceid=29, filesize=4.9 K 2023-11-13 04:53:57,702 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 27cb223f9866bdc4989cc22b2513873e in 429ms, sequenceid=29, compaction requested=true 2023-11-13 04:53:57,703 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 27cb223f9866bdc4989cc22b2513873e: 2023-11-13 04:53:57,703 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e. 2023-11-13 04:53:57,703 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:53:57,703 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:53:57,703 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:57,703 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-13 04:53:57,703 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-13 04:53:57,705 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:57,705 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:57,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:57,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:57,705 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,706 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:53:57,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:57,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:57,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:57,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:57,707 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-13 04:53:57,707 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2e11e94d[Count = 0] remaining members to acquire global barrier 2023-11-13 04:53:57,707 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-13 04:53:57,707 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,708 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,709 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-13 04:53:57,709 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-13 04:53:57,709 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:53:57,709 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:57,709 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:53:57,710 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:57,710 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-13 04:53:57,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:57,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:57,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:57,710 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:57,710 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-13 04:53:57,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:57,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:57,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:57,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:57,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:57,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:53:57,713 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-13 04:53:57,713 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-13 04:53:57,713 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:53:57,713 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:53:57,713 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,713 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:53:57,719 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,719 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:57,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:57,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,719 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:57,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:57,720 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:57,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:57,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:57,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:57,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:57,721 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:57,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:57,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:57,723 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:57,723 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:57,723 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,723 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:57,723 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:57,724 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-13 04:53:57,724 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:53:57,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:57,724 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:57,724 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:57,724 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,724 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,724 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-13 04:53:57,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:57,724 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:57,724 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:53:57,824 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:53:57,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:53:57,829 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:53:57,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-13 04:53:57,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,831 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-13 04:53:57,831 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:57,831 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-13 04:53:57,831 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-13 04:53:57,832 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,832 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,833 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:57,833 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:57,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:57,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:57,833 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:57,833 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:53:57,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,834 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:53:57,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,834 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,834 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-13 04:53:57,834 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:57,834 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-13 04:53:57,834 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:57,834 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-13 04:53:57,835 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:53:57,835 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:53:57,835 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e. 2023-11-13 04:53:57,835 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e. started... 2023-11-13 04:53:57,835 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 27cb223f9866bdc4989cc22b2513873e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:53:58,249 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010363afc064d6af4f03a6f001eb9d218bde to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010363afc064d6af4f03a6f001eb9d218bde 2023-11-13 04:53:58,655 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/.tmp/family1/b4880a2f2c5347ecb26eb4d4c62958cf 2023-11-13 04:53:58,660 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/.tmp/family1/b4880a2f2c5347ecb26eb4d4c62958cf as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/b4880a2f2c5347ecb26eb4d4c62958cf 2023-11-13 04:53:58,665 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/b4880a2f2c5347ecb26eb4d4c62958cf, entries=1, sequenceid=33, filesize=4.9 K 2023-11-13 04:53:58,666 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 27cb223f9866bdc4989cc22b2513873e in 830ms, sequenceid=33, compaction requested=true 2023-11-13 04:53:58,666 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 27cb223f9866bdc4989cc22b2513873e: 2023-11-13 04:53:58,666 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e. 2023-11-13 04:53:58,666 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:53:58,666 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:53:58,666 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:58,666 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-13 04:53:58,666 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-13 04:53:58,668 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:58,668 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:58,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:58,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:58,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:58,668 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:58,668 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:53:58,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:58,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:58,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:58,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:58,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:58,670 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-13 04:53:58,670 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6bba96c[Count = 0] remaining members to acquire global barrier 2023-11-13 04:53:58,670 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-13 04:53:58,670 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:58,672 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:58,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:58,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:58,672 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-13 04:53:58,672 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-13 04:53:58,672 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:53:58,672 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:58,672 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:53:58,673 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:58,673 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-13 04:53:58,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:58,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:58,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:58,673 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:58,674 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-13 04:53:58,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:58,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:58,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:58,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:58,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:58,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:58,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:58,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:53:58,676 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-13 04:53:58,676 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-13 04:53:58,676 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:53:58,676 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:53:58,676 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:58,676 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:53:58,678 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:58,678 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:58,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:58,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:58,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:58,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:58,678 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:58,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:58,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:58,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:58,678 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:58,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:58,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:58,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:58,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:58,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:58,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:58,680 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:58,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:58,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:58,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:58,682 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:58,682 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:58,682 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:58,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:58,682 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:58,682 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-13 04:53:58,682 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:53:58,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:58,682 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:58,682 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:58,682 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:58,682 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:58,683 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:58,683 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-13 04:53:58,683 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:53:58,682 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:58,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:58,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:58,783 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:53:58,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:53:58,788 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:53:58,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-13 04:53:58,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:58,789 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-13 04:53:58,789 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:58,789 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-13 04:53:58,789 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-13 04:53:58,790 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:58,790 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:58,792 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:58,792 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:58,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:58,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:58,793 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:58,793 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:53:58,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:58,793 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:58,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:53:58,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:58,793 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:58,794 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-13 04:53:58,794 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:58,794 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-13 04:53:58,794 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:58,794 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-13 04:53:58,794 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:53:58,794 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:53:58,794 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e. 2023-11-13 04:53:58,794 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e. started... 2023-11-13 04:53:58,794 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 27cb223f9866bdc4989cc22b2513873e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:53:59,207 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509072ca9bd2484154faca54296294dfabffd to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201509072ca9bd2484154faca54296294dfabffd 2023-11-13 04:53:59,613 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/.tmp/family1/6951cf52c5a84bbbb1ac777f94d4f3c0 2023-11-13 04:53:59,618 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/.tmp/family1/6951cf52c5a84bbbb1ac777f94d4f3c0 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/6951cf52c5a84bbbb1ac777f94d4f3c0 2023-11-13 04:53:59,623 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/6951cf52c5a84bbbb1ac777f94d4f3c0, entries=1, sequenceid=37, filesize=4.9 K 2023-11-13 04:53:59,624 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 27cb223f9866bdc4989cc22b2513873e in 830ms, sequenceid=37, compaction requested=true 2023-11-13 04:53:59,624 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 27cb223f9866bdc4989cc22b2513873e: 2023-11-13 04:53:59,624 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e. 2023-11-13 04:53:59,624 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:53:59,625 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:53:59,625 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:59,625 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-13 04:53:59,625 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-13 04:53:59,627 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:59,627 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:59,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:59,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:59,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:59,627 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:59,627 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:53:59,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:59,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:59,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:59,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:59,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:59,629 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-13 04:53:59,629 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51277b7e[Count = 0] remaining members to acquire global barrier 2023-11-13 04:53:59,629 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-13 04:53:59,630 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:59,631 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:59,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:59,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:59,631 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-13 04:53:59,631 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-13 04:53:59,631 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:53:59,631 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:59,632 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:53:59,633 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-13 04:53:59,633 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:59,633 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:59,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:59,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:59,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:59,633 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-13 04:53:59,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:59,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:59,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:59,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:59,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:59,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:59,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:59,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:53:59,636 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-13 04:53:59,636 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-13 04:53:59,636 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:53:59,636 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:53:59,636 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:59,636 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:53:59,639 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:59,639 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:59,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:59,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:59,639 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:59,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:59,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:53:59,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:53:59,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:59,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:59,639 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:59,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:53:59,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:59,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:59,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:53:59,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:59,641 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:59,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:59,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:53:59,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:59,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:59,643 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:59,643 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:59,643 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:59,643 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:59,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:59,643 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:53:59,643 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:53:59,643 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-13 04:53:59,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:59,643 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-13 04:53:59,644 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:53:59,643 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:59,644 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:59,644 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:59,644 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:59,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:53:59,644 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-13 04:53:59,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:53:59,644 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:53:59,744 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:53:59,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:53:59,749 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:53:59,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-13 04:53:59,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:59,751 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-13 04:53:59,751 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:59,751 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-13 04:53:59,751 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-13 04:53:59,751 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:59,751 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:59,753 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:59,753 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:53:59,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:53:59,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:53:59,753 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:53:59,753 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:53:59,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:59,754 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:59,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:53:59,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:59,754 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:59,754 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-13 04:53:59,754 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-13 04:53:59,754 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-13 04:53:59,754 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:53:59,754 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-13 04:53:59,755 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:53:59,755 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:53:59,755 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e. 2023-11-13 04:53:59,755 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e. started... 2023-11-13 04:53:59,755 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 27cb223f9866bdc4989cc22b2513873e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:54:00,169 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120ef177f797a6d4a3481db89fc8872c1e3 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151120ef177f797a6d4a3481db89fc8872c1e3 2023-11-13 04:54:00,575 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/.tmp/family1/a2186582204f44a394b9ce1e2c823290 2023-11-13 04:54:00,580 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/.tmp/family1/a2186582204f44a394b9ce1e2c823290 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/a2186582204f44a394b9ce1e2c823290 2023-11-13 04:54:00,585 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/a2186582204f44a394b9ce1e2c823290, entries=1, sequenceid=41, filesize=4.9 K 2023-11-13 04:54:00,586 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 27cb223f9866bdc4989cc22b2513873e in 831ms, sequenceid=41, compaction requested=true 2023-11-13 04:54:00,586 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 27cb223f9866bdc4989cc22b2513873e: 2023-11-13 04:54:00,586 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e. 2023-11-13 04:54:00,586 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:54:00,586 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:54:00,586 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:00,586 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-13 04:54:00,586 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-13 04:54:00,588 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:54:00,588 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:00,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:00,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:00,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:00,588 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:54:00,588 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:54:00,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:00,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:00,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:54:00,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:00,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:00,590 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-13 04:54:00,590 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@17089d2a[Count = 0] remaining members to acquire global barrier 2023-11-13 04:54:00,590 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-13 04:54:00,590 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:54:00,594 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:54:00,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:54:00,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:54:00,594 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-13 04:54:00,594 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-13 04:54:00,594 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:54:00,594 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:00,594 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:54:00,596 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:00,596 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-13 04:54:00,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:00,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:00,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:00,596 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:00,596 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-13 04:54:00,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:00,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:00,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:54:00,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:00,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:00,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:54:00,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:00,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:54:00,598 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-13 04:54:00,598 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-13 04:54:00,599 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:54:00,599 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:54:00,599 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-13 04:54:00,599 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:54:00,600 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:54:00,600 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:54:00,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:54:00,600 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:00,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:54:00,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:54:00,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:00,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:00,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:00,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:00,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:00,601 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:00,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:54:00,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:54:00,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:00,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:54:00,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:00,603 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:00,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:00,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-13 04:54:00,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:00,605 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:00,605 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:54:00,605 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:54:00,605 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:00,605 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:00,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:00,605 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:00,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:00,605 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:00,605 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-13 04:54:00,606 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:54:00,605 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:54:00,606 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:54:00,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:00,606 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-13 04:54:00,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:00,606 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-13 04:54:00,606 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:54:00,706 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:54:00,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:54:00,708 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33831] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-11-13 04:54:00,710 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-13 04:54:00,711 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-13 04:54:00,712 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-13 04:54:00,712 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699851840712 2023-11-13 04:54:00,713 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-13 04:54:00,714 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-11-13 04:54:00,714 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-13 04:54:00,716 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] zookeeper.ReadOnlyZKClient(139): Connect 0x46d5da0b to 127.0.0.1:51072 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-13 04:54:00,722 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4201d6a9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-13 04:54:00,722 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-13 04:54:01,574 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010371d4cd6421414b8f9797b68fb14e57e2 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010371d4cd6421414b8f9797b68fb14e57e2 2023-11-13 04:54:01,575 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-13 04:54:01,588 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-13 04:54:01,589 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45980, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-13 04:54:01,596 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-13 04:54:01,598 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56752, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-13 04:54:01,608 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/858772eab80544e78531e669b82eab12 first=Optional[r3] last=Optional[r6] 2023-11-13 04:54:01,608 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e., hostname=jenkins-hbase4.apache.org,41657,1699851201532, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/858772eab80544e78531e669b82eab12}] 2023-11-13 04:54:01,613 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(763): Validating hfile at hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/858772eab80544e78531e669b82eab12 for inclusion in 27cb223f9866bdc4989cc22b2513873e/family1 2023-11-13 04:54:01,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-13 04:54:01,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(777): Region bounds: first= last= 2023-11-13 04:54:01,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HRegion(2446): Flush status journal for 27cb223f9866bdc4989cc22b2513873e: 2023-11-13 04:54:01,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/858772eab80544e78531e669b82eab12 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMinorCompactionWithWeeklyPolicy__nre3m2a4tv4p96os6p93jmi4abva8gleja3rue8d3kv2a2ts2apdc9h9gimvehh9/family1/858772eab80544e78531e669b82eab12 2023-11-13 04:54:01,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMinorCompactionWithWeeklyPolicy__nre3m2a4tv4p96os6p93jmi4abva8gleja3rue8d3kv2a2ts2apdc9h9gimvehh9/family1/858772eab80544e78531e669b82eab12 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/e3278ad9a5ad4964aeca83d8d32d2927_SeqId_44_ 2023-11-13 04:54:01,622 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(849): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMinorCompactionWithWeeklyPolicy__nre3m2a4tv4p96os6p93jmi4abva8gleja3rue8d3kv2a2ts2apdc9h9gimvehh9/family1/858772eab80544e78531e669b82eab12 into 27cb223f9866bdc4989cc22b2513873e/family1 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/e3278ad9a5ad4964aeca83d8d32d2927_SeqId_44_ - updating store file list. 2023-11-13 04:54:01,627 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(882): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/e3278ad9a5ad4964aeca83d8d32d2927_SeqId_44_ into 27cb223f9866bdc4989cc22b2513873e/family1 2023-11-13 04:54:01,627 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(855): Successfully loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMinorCompactionWithWeeklyPolicy__nre3m2a4tv4p96os6p93jmi4abva8gleja3rue8d3kv2a2ts2apdc9h9gimvehh9/family1/858772eab80544e78531e669b82eab12 into 27cb223f9866bdc4989cc22b2513873e/family1 (new location: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/e3278ad9a5ad4964aeca83d8d32d2927_SeqId_44_) 2023-11-13 04:54:01,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMinorCompactionWithWeeklyPolicy__nre3m2a4tv4p96os6p93jmi4abva8gleja3rue8d3kv2a2ts2apdc9h9gimvehh9/family1/858772eab80544e78531e669b82eab12 2023-11-13 04:54:01,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-13 04:54:01,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-13 04:54:01,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(1912): 27cb223f9866bdc4989cc22b2513873e/family1 is initiating minor compaction 2023-11-13 04:54:01,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@52f1abda; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-13 04:54:01,631 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 27cb223f9866bdc4989cc22b2513873e/family1 in testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e. 2023-11-13 04:54:01,631 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/1a03324977f2479996acf8c7831bce1f, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/2ebe57fbd5554d43b12efb523f8dcc45, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/ebd23af5a0144a6a9354d58b2bd7ba16, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/296c63ced28b4561ac9c73286c8770b6, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/c0cedd511300441b9a80c329b32893d4, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/267af44590654b41aabd1ce7c2ce48cf, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/b4880a2f2c5347ecb26eb4d4c62958cf, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/6951cf52c5a84bbbb1ac777f94d4f3c0, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/a2186582204f44a394b9ce1e2c823290, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/e3278ad9a5ad4964aeca83d8d32d2927_SeqId_44_] into tmpdir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/.tmp, totalSize=50.0 K 2023-11-13 04:54:01,631 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 1a03324977f2479996acf8c7831bce1f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-13 04:54:01,631 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 2ebe57fbd5554d43b12efb523f8dcc45, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-13 04:54:01,631 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting ebd23af5a0144a6a9354d58b2bd7ba16, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-13 04:54:01,631 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 296c63ced28b4561ac9c73286c8770b6, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-13 04:54:01,631 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting c0cedd511300441b9a80c329b32893d4, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-13 04:54:01,632 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 267af44590654b41aabd1ce7c2ce48cf, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-13 04:54:01,632 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting b4880a2f2c5347ecb26eb4d4c62958cf, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-13 04:54:01,632 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 6951cf52c5a84bbbb1ac777f94d4f3c0, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-13 04:54:01,632 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting a2186582204f44a394b9ce1e2c823290, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-13 04:54:01,632 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting e3278ad9a5ad4964aeca83d8d32d2927_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-13 04:54:01,633 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-13 04:54:01,634 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:54:01,636 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015122861dc0cc455144059901e5f9ed8f605e6 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015122861dc0cc455144059901e5f9ed8f605e6 2023-11-13 04:54:01,637 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512316ff211de4e65429f9cc04404f3feaf76 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512316ff211de4e65429f9cc04404f3feaf76 2023-11-13 04:54:01,638 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010122d106b0c673448eabf4dc6956cfa383 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010122d106b0c673448eabf4dc6956cfa383 2023-11-13 04:54:01,639 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010363afc064d6af4f03a6f001eb9d218bde to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010363afc064d6af4f03a6f001eb9d218bde 2023-11-13 04:54:01,639 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-11-13 04:54:01,639 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-13 04:54:01,640 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-13 04:54:01,640 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-13 04:54:01,640 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-13 04:54:01,640 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-13 04:54:01,640 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-13 04:54:01,640 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-13 04:54:01,640 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-13 04:54:01,640 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-13 04:54:01,669 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] throttle.PressureAwareThroughputController(145): 27cb223f9866bdc4989cc22b2513873e#family1#compaction#34 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-13 04:54:02,081 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120544892403241e47e2a589aa85a49eeb39 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120544892403241e47e2a589aa85a49eeb39 2023-11-13 04:54:02,082 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-13 04:54:02,107 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/4b3039a6b9774193acc54808864f13c5 first=Optional[r1] last=Optional[r2] 2023-11-13 04:54:02,108 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e., hostname=jenkins-hbase4.apache.org,41657,1699851201532, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/4b3039a6b9774193acc54808864f13c5}] 2023-11-13 04:54:02,111 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(763): Validating hfile at hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/4b3039a6b9774193acc54808864f13c5 for inclusion in 27cb223f9866bdc4989cc22b2513873e/family1 2023-11-13 04:54:02,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-11-13 04:54:02,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(777): Region bounds: first= last= 2023-11-13 04:54:02,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HRegion(2446): Flush status journal for 27cb223f9866bdc4989cc22b2513873e: 2023-11-13 04:54:02,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/4b3039a6b9774193acc54808864f13c5 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMinorCompactionWithWeeklyPolicy__h4nr8fdn0cfsuunic04o7uu85bqim6r9bkoqfepn2qj40rp3g944g7css52pmcht/family1/4b3039a6b9774193acc54808864f13c5 2023-11-13 04:54:02,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMinorCompactionWithWeeklyPolicy__h4nr8fdn0cfsuunic04o7uu85bqim6r9bkoqfepn2qj40rp3g944g7css52pmcht/family1/4b3039a6b9774193acc54808864f13c5 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/df91e60b43064d678aeddd8267fe9ea4_SeqId_46_ 2023-11-13 04:54:02,119 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(849): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMinorCompactionWithWeeklyPolicy__h4nr8fdn0cfsuunic04o7uu85bqim6r9bkoqfepn2qj40rp3g944g7css52pmcht/family1/4b3039a6b9774193acc54808864f13c5 into 27cb223f9866bdc4989cc22b2513873e/family1 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/df91e60b43064d678aeddd8267fe9ea4_SeqId_46_ - updating store file list. 2023-11-13 04:54:02,122 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(882): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/df91e60b43064d678aeddd8267fe9ea4_SeqId_46_ into 27cb223f9866bdc4989cc22b2513873e/family1 2023-11-13 04:54:02,123 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(855): Successfully loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMinorCompactionWithWeeklyPolicy__h4nr8fdn0cfsuunic04o7uu85bqim6r9bkoqfepn2qj40rp3g944g7css52pmcht/family1/4b3039a6b9774193acc54808864f13c5 into 27cb223f9866bdc4989cc22b2513873e/family1 (new location: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/df91e60b43064d678aeddd8267fe9ea4_SeqId_46_) 2023-11-13 04:54:02,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMinorCompactionWithWeeklyPolicy__h4nr8fdn0cfsuunic04o7uu85bqim6r9bkoqfepn2qj40rp3g944g7css52pmcht/family1/4b3039a6b9774193acc54808864f13c5 2023-11-13 04:54:02,125 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-13 04:54:02,125 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:54:02,127 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512012fdee63e9d7f4f168e73a1b67329293a to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512012fdee63e9d7f4f168e73a1b67329293a 2023-11-13 04:54:02,128 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512051c375daabd4b4dda8034fab0af73a926 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512051c375daabd4b4dda8034fab0af73a926 2023-11-13 04:54:02,128 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-11-13 04:54:02,128 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-13 04:54:02,128 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-13 04:54:02,128 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-13 04:54:02,128 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-13 04:54:02,129 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-13 04:54:02,131 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.4210 sec 2023-11-13 04:54:02,239 INFO [Listener at localhost/34517] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=260 (was 259) - Thread LEAK? -, OpenFileDescriptor=653 (was 642) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=183 (was 235), ProcessCount=169 (was 169), AvailableMemoryMB=2591 (was 2736) 2023-11-13 04:54:02,249 INFO [Listener at localhost/34517] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=260, OpenFileDescriptor=653, MaxFileDescriptor=60000, SystemLoadAverage=183, ProcessCount=169, AvailableMemoryMB=2590 2023-11-13 04:54:02,252 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-13 04:54:02,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:02,255 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-11-13 04:54:02,255 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-11-13 04:54:02,255 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-13 04:54:02,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-13 04:54:02,258 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testScannerOnBulkLoadRefHFiles/65bf1eecde5a83e1bebe47c93d288912 2023-11-13 04:54:02,258 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testScannerOnBulkLoadRefHFiles/b118e2043963096bdb82baf7b4023e66 2023-11-13 04:54:02,258 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testScannerOnBulkLoadRefHFiles/90df22d5e18546f877e84e0c244138f5 2023-11-13 04:54:02,258 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testScannerOnBulkLoadRefHFiles/65bf1eecde5a83e1bebe47c93d288912 empty. 2023-11-13 04:54:02,258 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testScannerOnBulkLoadRefHFiles/90df22d5e18546f877e84e0c244138f5 empty. 2023-11-13 04:54:02,258 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testScannerOnBulkLoadRefHFiles/b118e2043963096bdb82baf7b4023e66 empty. 2023-11-13 04:54:02,259 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testScannerOnBulkLoadRefHFiles/65bf1eecde5a83e1bebe47c93d288912 2023-11-13 04:54:02,259 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testScannerOnBulkLoadRefHFiles/b118e2043963096bdb82baf7b4023e66 2023-11-13 04:54:02,259 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testScannerOnBulkLoadRefHFiles/90df22d5e18546f877e84e0c244138f5 2023-11-13 04:54:02,259 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-11-13 04:54:02,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-13 04:54:02,487 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/.tmp/family1/c72ff012e9b24b05afb992d929777ea2 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/c72ff012e9b24b05afb992d929777ea2 2023-11-13 04:54:02,492 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 27cb223f9866bdc4989cc22b2513873e/family1 of 27cb223f9866bdc4989cc22b2513873e into c72ff012e9b24b05afb992d929777ea2(size=6.6 K), total size for store is 176.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-13 04:54:02,492 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 27cb223f9866bdc4989cc22b2513873e: 2023-11-13 04:54:02,492 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1699851241631; duration=0sec 2023-11-13 04:54:02,492 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-13 04:54:02,547 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/1a03324977f2479996acf8c7831bce1f, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/2ebe57fbd5554d43b12efb523f8dcc45, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/ebd23af5a0144a6a9354d58b2bd7ba16, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/296c63ced28b4561ac9c73286c8770b6, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/c0cedd511300441b9a80c329b32893d4, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/267af44590654b41aabd1ce7c2ce48cf, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/b4880a2f2c5347ecb26eb4d4c62958cf, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/6951cf52c5a84bbbb1ac777f94d4f3c0, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/a2186582204f44a394b9ce1e2c823290, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/e3278ad9a5ad4964aeca83d8d32d2927_SeqId_44_] to archive 2023-11-13 04:54:02,547 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:54:02,549 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/1a03324977f2479996acf8c7831bce1f to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/1a03324977f2479996acf8c7831bce1f 2023-11-13 04:54:02,551 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/2ebe57fbd5554d43b12efb523f8dcc45 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/2ebe57fbd5554d43b12efb523f8dcc45 2023-11-13 04:54:02,552 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/ebd23af5a0144a6a9354d58b2bd7ba16 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/ebd23af5a0144a6a9354d58b2bd7ba16 2023-11-13 04:54:02,554 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/296c63ced28b4561ac9c73286c8770b6 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/296c63ced28b4561ac9c73286c8770b6 2023-11-13 04:54:02,555 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/c0cedd511300441b9a80c329b32893d4 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/c0cedd511300441b9a80c329b32893d4 2023-11-13 04:54:02,556 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/267af44590654b41aabd1ce7c2ce48cf to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/267af44590654b41aabd1ce7c2ce48cf 2023-11-13 04:54:02,557 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/b4880a2f2c5347ecb26eb4d4c62958cf to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/b4880a2f2c5347ecb26eb4d4c62958cf 2023-11-13 04:54:02,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-13 04:54:02,559 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/6951cf52c5a84bbbb1ac777f94d4f3c0 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/6951cf52c5a84bbbb1ac777f94d4f3c0 2023-11-13 04:54:02,560 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/a2186582204f44a394b9ce1e2c823290 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/a2186582204f44a394b9ce1e2c823290 2023-11-13 04:54:02,561 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/e3278ad9a5ad4964aeca83d8d32d2927_SeqId_44_ to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/family1/e3278ad9a5ad4964aeca83d8d32d2927_SeqId_44_ 2023-11-13 04:54:02,667 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-11-13 04:54:02,668 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7675): creating {ENCODED => 65bf1eecde5a83e1bebe47c93d288912, NAME => 'testScannerOnBulkLoadRefHFiles,,1699851242251.65bf1eecde5a83e1bebe47c93d288912.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp 2023-11-13 04:54:02,669 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7675): creating {ENCODED => 90df22d5e18546f877e84e0c244138f5, NAME => 'testScannerOnBulkLoadRefHFiles,2,1699851242251.90df22d5e18546f877e84e0c244138f5.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp 2023-11-13 04:54:02,669 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7675): creating {ENCODED => b118e2043963096bdb82baf7b4023e66, NAME => 'testScannerOnBulkLoadRefHFiles,1,1699851242251.b118e2043963096bdb82baf7b4023e66.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp 2023-11-13 04:54:02,677 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1699851242251.b118e2043963096bdb82baf7b4023e66.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-13 04:54:02,677 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1604): Closing b118e2043963096bdb82baf7b4023e66, disabling compactions & flushes 2023-11-13 04:54:02,677 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1699851242251.b118e2043963096bdb82baf7b4023e66. 2023-11-13 04:54:02,677 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1699851242251.b118e2043963096bdb82baf7b4023e66. 2023-11-13 04:54:02,677 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1699851242251.b118e2043963096bdb82baf7b4023e66. after waiting 0 ms 2023-11-13 04:54:02,677 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1699851242251.b118e2043963096bdb82baf7b4023e66. 2023-11-13 04:54:02,677 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1699851242251.b118e2043963096bdb82baf7b4023e66. 2023-11-13 04:54:02,677 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1558): Region close journal for b118e2043963096bdb82baf7b4023e66: 2023-11-13 04:54:02,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-13 04:54:03,076 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1699851242251.65bf1eecde5a83e1bebe47c93d288912.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-13 04:54:03,076 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1604): Closing 65bf1eecde5a83e1bebe47c93d288912, disabling compactions & flushes 2023-11-13 04:54:03,076 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1699851242251.65bf1eecde5a83e1bebe47c93d288912. 2023-11-13 04:54:03,076 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1699851242251.65bf1eecde5a83e1bebe47c93d288912. 2023-11-13 04:54:03,076 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1699851242251.65bf1eecde5a83e1bebe47c93d288912. after waiting 0 ms 2023-11-13 04:54:03,076 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1699851242251.65bf1eecde5a83e1bebe47c93d288912. 2023-11-13 04:54:03,076 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1699851242251.65bf1eecde5a83e1bebe47c93d288912. 2023-11-13 04:54:03,076 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1558): Region close journal for 65bf1eecde5a83e1bebe47c93d288912: 2023-11-13 04:54:03,077 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1699851242251.90df22d5e18546f877e84e0c244138f5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-13 04:54:03,077 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1604): Closing 90df22d5e18546f877e84e0c244138f5, disabling compactions & flushes 2023-11-13 04:54:03,077 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1699851242251.90df22d5e18546f877e84e0c244138f5. 2023-11-13 04:54:03,077 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1699851242251.90df22d5e18546f877e84e0c244138f5. 2023-11-13 04:54:03,077 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1699851242251.90df22d5e18546f877e84e0c244138f5. after waiting 0 ms 2023-11-13 04:54:03,077 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1699851242251.90df22d5e18546f877e84e0c244138f5. 2023-11-13 04:54:03,077 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1699851242251.90df22d5e18546f877e84e0c244138f5. 2023-11-13 04:54:03,077 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1558): Region close journal for 90df22d5e18546f877e84e0c244138f5: 2023-11-13 04:54:03,080 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-11-13 04:54:03,080 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1699851242251.b118e2043963096bdb82baf7b4023e66.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1699851243080"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699851243080"}]},"ts":"1699851243080"} 2023-11-13 04:54:03,081 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1699851242251.65bf1eecde5a83e1bebe47c93d288912.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1699851243080"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699851243080"}]},"ts":"1699851243080"} 2023-11-13 04:54:03,081 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1699851242251.90df22d5e18546f877e84e0c244138f5.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1699851243080"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699851243080"}]},"ts":"1699851243080"} 2023-11-13 04:54:03,083 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-13 04:54:03,084 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-13 04:54:03,084 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699851243084"}]},"ts":"1699851243084"} 2023-11-13 04:54:03,085 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-11-13 04:54:03,089 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=65bf1eecde5a83e1bebe47c93d288912, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=b118e2043963096bdb82baf7b4023e66, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=90df22d5e18546f877e84e0c244138f5, ASSIGN}] 2023-11-13 04:54:03,091 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=b118e2043963096bdb82baf7b4023e66, ASSIGN 2023-11-13 04:54:03,091 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=65bf1eecde5a83e1bebe47c93d288912, ASSIGN 2023-11-13 04:54:03,091 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=90df22d5e18546f877e84e0c244138f5, ASSIGN 2023-11-13 04:54:03,092 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=b118e2043963096bdb82baf7b4023e66, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41657,1699851201532; forceNewPlan=false, retain=false 2023-11-13 04:54:03,092 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=90df22d5e18546f877e84e0c244138f5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41657,1699851201532; forceNewPlan=false, retain=false 2023-11-13 04:54:03,092 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=65bf1eecde5a83e1bebe47c93d288912, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41657,1699851201532; forceNewPlan=false, retain=false 2023-11-13 04:54:03,243 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=b118e2043963096bdb82baf7b4023e66, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:03,243 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=90df22d5e18546f877e84e0c244138f5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:03,243 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=65bf1eecde5a83e1bebe47c93d288912, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:03,244 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1699851242251.b118e2043963096bdb82baf7b4023e66.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1699851243243"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699851243243"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699851243243"}]},"ts":"1699851243243"} 2023-11-13 04:54:03,244 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1699851242251.65bf1eecde5a83e1bebe47c93d288912.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1699851243243"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699851243243"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699851243243"}]},"ts":"1699851243243"} 2023-11-13 04:54:03,244 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1699851242251.90df22d5e18546f877e84e0c244138f5.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1699851243243"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699851243243"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699851243243"}]},"ts":"1699851243243"} 2023-11-13 04:54:03,246 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure b118e2043963096bdb82baf7b4023e66, server=jenkins-hbase4.apache.org,41657,1699851201532}] 2023-11-13 04:54:03,246 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=32, ppid=28, state=RUNNABLE; OpenRegionProcedure 65bf1eecde5a83e1bebe47c93d288912, server=jenkins-hbase4.apache.org,41657,1699851201532}] 2023-11-13 04:54:03,247 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=33, ppid=30, state=RUNNABLE; OpenRegionProcedure 90df22d5e18546f877e84e0c244138f5, server=jenkins-hbase4.apache.org,41657,1699851201532}] 2023-11-13 04:54:03,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-13 04:54:03,398 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:03,401 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,,1699851242251.65bf1eecde5a83e1bebe47c93d288912. 2023-11-13 04:54:03,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 65bf1eecde5a83e1bebe47c93d288912, NAME => 'testScannerOnBulkLoadRefHFiles,,1699851242251.65bf1eecde5a83e1bebe47c93d288912.', STARTKEY => '', ENDKEY => '1'} 2023-11-13 04:54:03,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 65bf1eecde5a83e1bebe47c93d288912 2023-11-13 04:54:03,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1699851242251.65bf1eecde5a83e1bebe47c93d288912.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-13 04:54:03,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 65bf1eecde5a83e1bebe47c93d288912 2023-11-13 04:54:03,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 65bf1eecde5a83e1bebe47c93d288912 2023-11-13 04:54:03,403 INFO [StoreOpener-65bf1eecde5a83e1bebe47c93d288912-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 65bf1eecde5a83e1bebe47c93d288912 2023-11-13 04:54:03,404 DEBUG [StoreOpener-65bf1eecde5a83e1bebe47c93d288912-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testScannerOnBulkLoadRefHFiles/65bf1eecde5a83e1bebe47c93d288912/family1 2023-11-13 04:54:03,404 DEBUG [StoreOpener-65bf1eecde5a83e1bebe47c93d288912-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testScannerOnBulkLoadRefHFiles/65bf1eecde5a83e1bebe47c93d288912/family1 2023-11-13 04:54:03,405 INFO [StoreOpener-65bf1eecde5a83e1bebe47c93d288912-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 65bf1eecde5a83e1bebe47c93d288912 columnFamilyName family1 2023-11-13 04:54:03,406 INFO [StoreOpener-65bf1eecde5a83e1bebe47c93d288912-1] regionserver.HStore(310): Store=65bf1eecde5a83e1bebe47c93d288912/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-13 04:54:03,407 INFO [StoreOpener-65bf1eecde5a83e1bebe47c93d288912-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 65bf1eecde5a83e1bebe47c93d288912 2023-11-13 04:54:03,408 DEBUG [StoreOpener-65bf1eecde5a83e1bebe47c93d288912-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testScannerOnBulkLoadRefHFiles/65bf1eecde5a83e1bebe47c93d288912/family2 2023-11-13 04:54:03,408 DEBUG [StoreOpener-65bf1eecde5a83e1bebe47c93d288912-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testScannerOnBulkLoadRefHFiles/65bf1eecde5a83e1bebe47c93d288912/family2 2023-11-13 04:54:03,408 INFO [StoreOpener-65bf1eecde5a83e1bebe47c93d288912-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 65bf1eecde5a83e1bebe47c93d288912 columnFamilyName family2 2023-11-13 04:54:03,410 INFO [StoreOpener-65bf1eecde5a83e1bebe47c93d288912-1] regionserver.HStore(310): Store=65bf1eecde5a83e1bebe47c93d288912/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-13 04:54:03,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testScannerOnBulkLoadRefHFiles/65bf1eecde5a83e1bebe47c93d288912 2023-11-13 04:54:03,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testScannerOnBulkLoadRefHFiles/65bf1eecde5a83e1bebe47c93d288912 2023-11-13 04:54:03,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-13 04:54:03,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 65bf1eecde5a83e1bebe47c93d288912 2023-11-13 04:54:03,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testScannerOnBulkLoadRefHFiles/65bf1eecde5a83e1bebe47c93d288912/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-13 04:54:03,417 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 65bf1eecde5a83e1bebe47c93d288912; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75480908, jitterRate=0.12475317716598511}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-13 04:54:03,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 65bf1eecde5a83e1bebe47c93d288912: 2023-11-13 04:54:03,418 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1699851242251.65bf1eecde5a83e1bebe47c93d288912., pid=32, masterSystemTime=1699851243398 2023-11-13 04:54:03,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1699851242251.65bf1eecde5a83e1bebe47c93d288912. 2023-11-13 04:54:03,420 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,,1699851242251.65bf1eecde5a83e1bebe47c93d288912. 2023-11-13 04:54:03,420 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,2,1699851242251.90df22d5e18546f877e84e0c244138f5. 2023-11-13 04:54:03,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 90df22d5e18546f877e84e0c244138f5, NAME => 'testScannerOnBulkLoadRefHFiles,2,1699851242251.90df22d5e18546f877e84e0c244138f5.', STARTKEY => '2', ENDKEY => ''} 2023-11-13 04:54:03,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 90df22d5e18546f877e84e0c244138f5 2023-11-13 04:54:03,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1699851242251.90df22d5e18546f877e84e0c244138f5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-13 04:54:03,420 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=65bf1eecde5a83e1bebe47c93d288912, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:03,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 90df22d5e18546f877e84e0c244138f5 2023-11-13 04:54:03,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 90df22d5e18546f877e84e0c244138f5 2023-11-13 04:54:03,421 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1699851242251.65bf1eecde5a83e1bebe47c93d288912.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1699851243420"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699851243420"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699851243420"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699851243420"}]},"ts":"1699851243420"} 2023-11-13 04:54:03,422 INFO [StoreOpener-90df22d5e18546f877e84e0c244138f5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 90df22d5e18546f877e84e0c244138f5 2023-11-13 04:54:03,423 DEBUG [StoreOpener-90df22d5e18546f877e84e0c244138f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testScannerOnBulkLoadRefHFiles/90df22d5e18546f877e84e0c244138f5/family1 2023-11-13 04:54:03,424 DEBUG [StoreOpener-90df22d5e18546f877e84e0c244138f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testScannerOnBulkLoadRefHFiles/90df22d5e18546f877e84e0c244138f5/family1 2023-11-13 04:54:03,424 INFO [StoreOpener-90df22d5e18546f877e84e0c244138f5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 90df22d5e18546f877e84e0c244138f5 columnFamilyName family1 2023-11-13 04:54:03,424 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=32, resume processing ppid=28 2023-11-13 04:54:03,424 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=32, ppid=28, state=SUCCESS; OpenRegionProcedure 65bf1eecde5a83e1bebe47c93d288912, server=jenkins-hbase4.apache.org,41657,1699851201532 in 176 msec 2023-11-13 04:54:03,425 INFO [StoreOpener-90df22d5e18546f877e84e0c244138f5-1] regionserver.HStore(310): Store=90df22d5e18546f877e84e0c244138f5/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-13 04:54:03,425 INFO [StoreOpener-90df22d5e18546f877e84e0c244138f5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 90df22d5e18546f877e84e0c244138f5 2023-11-13 04:54:03,426 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=65bf1eecde5a83e1bebe47c93d288912, ASSIGN in 335 msec 2023-11-13 04:54:03,427 DEBUG [StoreOpener-90df22d5e18546f877e84e0c244138f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testScannerOnBulkLoadRefHFiles/90df22d5e18546f877e84e0c244138f5/family2 2023-11-13 04:54:03,427 DEBUG [StoreOpener-90df22d5e18546f877e84e0c244138f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testScannerOnBulkLoadRefHFiles/90df22d5e18546f877e84e0c244138f5/family2 2023-11-13 04:54:03,428 INFO [StoreOpener-90df22d5e18546f877e84e0c244138f5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 90df22d5e18546f877e84e0c244138f5 columnFamilyName family2 2023-11-13 04:54:03,429 INFO [StoreOpener-90df22d5e18546f877e84e0c244138f5-1] regionserver.HStore(310): Store=90df22d5e18546f877e84e0c244138f5/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-13 04:54:03,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testScannerOnBulkLoadRefHFiles/90df22d5e18546f877e84e0c244138f5 2023-11-13 04:54:03,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testScannerOnBulkLoadRefHFiles/90df22d5e18546f877e84e0c244138f5 2023-11-13 04:54:03,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-13 04:54:03,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 90df22d5e18546f877e84e0c244138f5 2023-11-13 04:54:03,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testScannerOnBulkLoadRefHFiles/90df22d5e18546f877e84e0c244138f5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-13 04:54:03,435 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 90df22d5e18546f877e84e0c244138f5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74094870, jitterRate=0.10409960150718689}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-13 04:54:03,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 90df22d5e18546f877e84e0c244138f5: 2023-11-13 04:54:03,436 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1699851242251.90df22d5e18546f877e84e0c244138f5., pid=33, masterSystemTime=1699851243398 2023-11-13 04:54:03,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1699851242251.90df22d5e18546f877e84e0c244138f5. 2023-11-13 04:54:03,438 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,2,1699851242251.90df22d5e18546f877e84e0c244138f5. 2023-11-13 04:54:03,438 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,1,1699851242251.b118e2043963096bdb82baf7b4023e66. 2023-11-13 04:54:03,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b118e2043963096bdb82baf7b4023e66, NAME => 'testScannerOnBulkLoadRefHFiles,1,1699851242251.b118e2043963096bdb82baf7b4023e66.', STARTKEY => '1', ENDKEY => '2'} 2023-11-13 04:54:03,438 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=90df22d5e18546f877e84e0c244138f5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:03,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles b118e2043963096bdb82baf7b4023e66 2023-11-13 04:54:03,438 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1699851242251.90df22d5e18546f877e84e0c244138f5.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1699851243438"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699851243438"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699851243438"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699851243438"}]},"ts":"1699851243438"} 2023-11-13 04:54:03,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1699851242251.b118e2043963096bdb82baf7b4023e66.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-13 04:54:03,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b118e2043963096bdb82baf7b4023e66 2023-11-13 04:54:03,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b118e2043963096bdb82baf7b4023e66 2023-11-13 04:54:03,439 INFO [StoreOpener-b118e2043963096bdb82baf7b4023e66-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b118e2043963096bdb82baf7b4023e66 2023-11-13 04:54:03,441 DEBUG [StoreOpener-b118e2043963096bdb82baf7b4023e66-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testScannerOnBulkLoadRefHFiles/b118e2043963096bdb82baf7b4023e66/family1 2023-11-13 04:54:03,441 DEBUG [StoreOpener-b118e2043963096bdb82baf7b4023e66-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testScannerOnBulkLoadRefHFiles/b118e2043963096bdb82baf7b4023e66/family1 2023-11-13 04:54:03,441 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=33, resume processing ppid=30 2023-11-13 04:54:03,441 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=33, ppid=30, state=SUCCESS; OpenRegionProcedure 90df22d5e18546f877e84e0c244138f5, server=jenkins-hbase4.apache.org,41657,1699851201532 in 192 msec 2023-11-13 04:54:03,441 INFO [StoreOpener-b118e2043963096bdb82baf7b4023e66-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b118e2043963096bdb82baf7b4023e66 columnFamilyName family1 2023-11-13 04:54:03,442 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=90df22d5e18546f877e84e0c244138f5, ASSIGN in 352 msec 2023-11-13 04:54:03,442 INFO [StoreOpener-b118e2043963096bdb82baf7b4023e66-1] regionserver.HStore(310): Store=b118e2043963096bdb82baf7b4023e66/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-13 04:54:03,443 INFO [StoreOpener-b118e2043963096bdb82baf7b4023e66-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region b118e2043963096bdb82baf7b4023e66 2023-11-13 04:54:03,444 DEBUG [StoreOpener-b118e2043963096bdb82baf7b4023e66-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testScannerOnBulkLoadRefHFiles/b118e2043963096bdb82baf7b4023e66/family2 2023-11-13 04:54:03,444 DEBUG [StoreOpener-b118e2043963096bdb82baf7b4023e66-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testScannerOnBulkLoadRefHFiles/b118e2043963096bdb82baf7b4023e66/family2 2023-11-13 04:54:03,444 INFO [StoreOpener-b118e2043963096bdb82baf7b4023e66-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b118e2043963096bdb82baf7b4023e66 columnFamilyName family2 2023-11-13 04:54:03,445 INFO [StoreOpener-b118e2043963096bdb82baf7b4023e66-1] regionserver.HStore(310): Store=b118e2043963096bdb82baf7b4023e66/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-13 04:54:03,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testScannerOnBulkLoadRefHFiles/b118e2043963096bdb82baf7b4023e66 2023-11-13 04:54:03,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testScannerOnBulkLoadRefHFiles/b118e2043963096bdb82baf7b4023e66 2023-11-13 04:54:03,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-13 04:54:03,468 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-13 04:54:03,469 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x586dde8d to 127.0.0.1:51072 2023-11-13 04:54:03,469 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-13 04:54:03,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b118e2043963096bdb82baf7b4023e66 2023-11-13 04:54:03,470 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-13 04:54:03,470 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7f21c565 to 127.0.0.1:51072 2023-11-13 04:54:03,470 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-13 04:54:03,470 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-13 04:54:03,470 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2de998e1 to 127.0.0.1:51072 2023-11-13 04:54:03,470 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-13 04:54:03,470 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-13 04:54:03,471 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x46d5da0b to 127.0.0.1:51072 2023-11-13 04:54:03,471 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-13 04:54:03,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testScannerOnBulkLoadRefHFiles/b118e2043963096bdb82baf7b4023e66/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-13 04:54:03,473 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b118e2043963096bdb82baf7b4023e66; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73394962, jitterRate=0.09367015957832336}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-13 04:54:03,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b118e2043963096bdb82baf7b4023e66: 2023-11-13 04:54:03,474 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1699851242251.b118e2043963096bdb82baf7b4023e66., pid=31, masterSystemTime=1699851243398 2023-11-13 04:54:03,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1699851242251.b118e2043963096bdb82baf7b4023e66. 2023-11-13 04:54:03,476 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,1,1699851242251.b118e2043963096bdb82baf7b4023e66. 2023-11-13 04:54:03,476 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=b118e2043963096bdb82baf7b4023e66, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:03,477 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1699851242251.b118e2043963096bdb82baf7b4023e66.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1699851243476"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699851243476"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699851243476"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699851243476"}]},"ts":"1699851243476"} 2023-11-13 04:54:03,480 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=29 2023-11-13 04:54:03,480 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure b118e2043963096bdb82baf7b4023e66, server=jenkins-hbase4.apache.org,41657,1699851201532 in 232 msec 2023-11-13 04:54:03,482 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=29, resume processing ppid=27 2023-11-13 04:54:03,482 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=b118e2043963096bdb82baf7b4023e66, ASSIGN in 391 msec 2023-11-13 04:54:03,482 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-13 04:54:03,483 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699851243483"}]},"ts":"1699851243483"} 2023-11-13 04:54:03,484 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-11-13 04:54:03,486 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-11-13 04:54:03,488 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 1.2340 sec 2023-11-13 04:54:04,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-13 04:54:04,361 INFO [Listener at localhost/34517] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-11-13 04:54:04,368 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:54:04,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:04,370 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-11-13 04:54:04,370 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:04,370 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-11-13 04:54:04,370 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-11-13 04:54:04,370 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:04,370 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:04,373 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:04,373 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:04,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:04,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:04,374 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:04,374 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:54:04,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:04,374 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:04,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:54:04,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:04,375 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:04,375 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:04,375 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-11-13 04:54:04,375 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:04,375 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-11-13 04:54:04,375 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1699851242251.b118e2043963096bdb82baf7b4023e66. 2023-11-13 04:54:04,375 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1699851242251.b118e2043963096bdb82baf7b4023e66. started... 2023-11-13 04:54:04,375 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1699851242251.65bf1eecde5a83e1bebe47c93d288912. 2023-11-13 04:54:04,375 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-13 04:54:04,376 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:54:04,376 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1699851242251.90df22d5e18546f877e84e0c244138f5. 2023-11-13 04:54:04,376 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1699851242251.90df22d5e18546f877e84e0c244138f5. started... 2023-11-13 04:54:04,375 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1699851242251.65bf1eecde5a83e1bebe47c93d288912. started... 2023-11-13 04:54:04,376 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b118e2043963096bdb82baf7b4023e66: 2023-11-13 04:54:04,377 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 65bf1eecde5a83e1bebe47c93d288912: 2023-11-13 04:54:04,376 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 90df22d5e18546f877e84e0c244138f5 2/2 column families, dataSize=48 B heapSize=632 B 2023-11-13 04:54:04,377 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1699851242251.65bf1eecde5a83e1bebe47c93d288912. 2023-11-13 04:54:04,377 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1699851242251.b118e2043963096bdb82baf7b4023e66. 2023-11-13 04:54:04,377 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-13 04:54:04,377 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-13 04:54:04,791 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231113433bfb228ebb46b38fe053a5eb8d4648 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231113433bfb228ebb46b38fe053a5eb8d4648 2023-11-13 04:54:04,834 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-11-13 04:54:05,196 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testScannerOnBulkLoadRefHFiles/90df22d5e18546f877e84e0c244138f5/.tmp/family1/edb37d45774240be9dd5db4c3ea7cb92 2023-11-13 04:54:05,202 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testScannerOnBulkLoadRefHFiles/90df22d5e18546f877e84e0c244138f5/.tmp/family1/edb37d45774240be9dd5db4c3ea7cb92 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testScannerOnBulkLoadRefHFiles/90df22d5e18546f877e84e0c244138f5/family1/edb37d45774240be9dd5db4c3ea7cb92 2023-11-13 04:54:05,207 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testScannerOnBulkLoadRefHFiles/90df22d5e18546f877e84e0c244138f5/family1/edb37d45774240be9dd5db4c3ea7cb92, entries=1, sequenceid=5, filesize=4.9 K 2023-11-13 04:54:05,208 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for 90df22d5e18546f877e84e0c244138f5 in 832ms, sequenceid=5, compaction requested=false 2023-11-13 04:54:05,209 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 90df22d5e18546f877e84e0c244138f5: 2023-11-13 04:54:05,209 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1699851242251.90df22d5e18546f877e84e0c244138f5. 2023-11-13 04:54:05,209 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-13 04:54:05,209 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-13 04:54:05,209 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:05,209 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-11-13 04:54:05,209 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-11-13 04:54:05,211 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:05,211 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:05,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:05,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:05,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:05,211 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:05,212 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:54:05,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:05,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:05,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:05,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:05,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:05,213 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-11-13 04:54:05,213 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@36f24507[Count = 0] remaining members to acquire global barrier 2023-11-13 04:54:05,213 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-11-13 04:54:05,213 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:05,216 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:05,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:05,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:05,216 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-11-13 04:54:05,216 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-11-13 04:54:05,216 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:54:05,216 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:05,216 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:54:05,217 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:05,217 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-11-13 04:54:05,218 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:05,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:05,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:05,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:05,218 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-11-13 04:54:05,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:05,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:05,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:05,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:05,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:05,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:05,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:05,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:54:05,220 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-11-13 04:54:05,220 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-11-13 04:54:05,220 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:54:05,220 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:54:05,220 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:05,220 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:54:05,222 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:05,222 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:05,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:05,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:05,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:05,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:05,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:05,222 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:05,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:05,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:05,222 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:05,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:05,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:05,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:05,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:05,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:05,224 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:05,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:05,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:05,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:05,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:05,226 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:05,226 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:05,227 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:05,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:05,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:05,227 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:05,227 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-11-13 04:54:05,227 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:05,227 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:05,227 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-11-13 04:54:05,227 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:54:05,227 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:05,227 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:05,227 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:05,227 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:05,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:05,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:05,227 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-11-13 04:54:05,227 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:54:05,327 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:54:05,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:54:05,332 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:54:05,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-11-13 04:54:05,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:05,334 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-11-13 04:54:05,334 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:05,334 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-11-13 04:54:05,334 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-11-13 04:54:05,335 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:05,335 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:05,338 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:05,338 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:05,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:05,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:05,338 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:05,338 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:54:05,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:05,338 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:05,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:54:05,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:05,339 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:05,339 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-11-13 04:54:05,339 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:05,339 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-11-13 04:54:05,339 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:05,339 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-11-13 04:54:05,339 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1699851242251.b118e2043963096bdb82baf7b4023e66. 2023-11-13 04:54:05,339 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1699851242251.b118e2043963096bdb82baf7b4023e66. started... 2023-11-13 04:54:05,339 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-13 04:54:05,339 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:54:05,339 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1699851242251.65bf1eecde5a83e1bebe47c93d288912. 2023-11-13 04:54:05,340 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1699851242251.65bf1eecde5a83e1bebe47c93d288912. started... 2023-11-13 04:54:05,339 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1699851242251.90df22d5e18546f877e84e0c244138f5. 2023-11-13 04:54:05,340 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1699851242251.90df22d5e18546f877e84e0c244138f5. started... 2023-11-13 04:54:05,339 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b118e2043963096bdb82baf7b4023e66: 2023-11-13 04:54:05,340 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 65bf1eecde5a83e1bebe47c93d288912: 2023-11-13 04:54:05,340 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 90df22d5e18546f877e84e0c244138f5 2/2 column families, dataSize=90 B heapSize=752 B 2023-11-13 04:54:05,340 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1699851242251.65bf1eecde5a83e1bebe47c93d288912. 2023-11-13 04:54:05,340 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1699851242251.b118e2043963096bdb82baf7b4023e66. 2023-11-13 04:54:05,340 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-13 04:54:05,340 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-13 04:54:05,753 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231113f9141275fd1d4f88a1722e37758e2a8f to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231113f9141275fd1d4f88a1722e37758e2a8f 2023-11-13 04:54:06,158 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testScannerOnBulkLoadRefHFiles/90df22d5e18546f877e84e0c244138f5/.tmp/family1/266819d039cf4d0dae3c2b201ac0fe5e 2023-11-13 04:54:06,163 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testScannerOnBulkLoadRefHFiles/90df22d5e18546f877e84e0c244138f5/.tmp/family1/266819d039cf4d0dae3c2b201ac0fe5e as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testScannerOnBulkLoadRefHFiles/90df22d5e18546f877e84e0c244138f5/family1/266819d039cf4d0dae3c2b201ac0fe5e 2023-11-13 04:54:06,167 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testScannerOnBulkLoadRefHFiles/90df22d5e18546f877e84e0c244138f5/family1/266819d039cf4d0dae3c2b201ac0fe5e, entries=2, sequenceid=9, filesize=5.0 K 2023-11-13 04:54:06,168 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for 90df22d5e18546f877e84e0c244138f5 in 828ms, sequenceid=9, compaction requested=false 2023-11-13 04:54:06,168 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 90df22d5e18546f877e84e0c244138f5: 2023-11-13 04:54:06,168 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1699851242251.90df22d5e18546f877e84e0c244138f5. 2023-11-13 04:54:06,168 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-13 04:54:06,168 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-13 04:54:06,169 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:06,169 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-11-13 04:54:06,169 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-11-13 04:54:06,171 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:06,171 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:06,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:06,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:06,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:06,171 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:06,171 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:54:06,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:06,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:06,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:06,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:06,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:06,172 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-11-13 04:54:06,172 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6dd96a7c[Count = 0] remaining members to acquire global barrier 2023-11-13 04:54:06,172 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-11-13 04:54:06,172 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:06,174 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:06,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:06,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:06,174 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-11-13 04:54:06,174 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-11-13 04:54:06,174 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:06,174 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:54:06,174 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:54:06,176 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-11-13 04:54:06,176 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:06,176 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:06,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:06,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:06,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:06,176 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-11-13 04:54:06,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:06,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:06,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:06,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:06,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:06,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:06,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:06,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:54:06,178 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-11-13 04:54:06,178 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-11-13 04:54:06,178 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:54:06,178 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:54:06,178 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:06,178 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:54:06,184 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:06,184 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:06,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:06,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:06,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:06,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:06,184 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:06,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:06,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:06,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:06,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:06,184 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:06,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:06,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:06,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:06,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:06,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:06,186 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:06,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:06,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:06,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:06,188 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:06,188 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:06,188 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:06,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:06,188 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-11-13 04:54:06,188 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:54:06,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:06,188 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:06,188 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:06,188 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:06,189 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-11-13 04:54:06,189 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:06,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:06,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:06,189 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:54:06,189 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:06,189 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:06,189 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:06,289 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:54:06,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:54:06,296 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33831] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-11-13 04:54:06,298 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-13 04:54:06,299 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-13 04:54:06,300 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-13 04:54:06,300 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699851846300 2023-11-13 04:54:06,300 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-13 04:54:06,301 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-11-13 04:54:06,301 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-13 04:54:06,302 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] zookeeper.ReadOnlyZKClient(139): Connect 0x7817aa2d to 127.0.0.1:51072 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-13 04:54:06,306 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@34ef8f18, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-13 04:54:06,306 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231113 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-11-13 04:54:07,133 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311130d6017be85404411a0fd87877e3961bf to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311130d6017be85404411a0fd87877e3961bf 2023-11-13 04:54:07,133 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231113 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-13 04:54:07,147 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-13 04:54:07,148 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43674, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-13 04:54:07,155 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-13 04:54:07,156 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36984, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-13 04:54:07,165 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231113/family1/15da03b766ff41e4bb3e655307838781 first=Optional[k0] last=Optional[k1] 2023-11-13 04:54:07,166 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1699851242251.90df22d5e18546f877e84e0c244138f5., hostname=jenkins-hbase4.apache.org,41657,1699851201532, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231113/family1/15da03b766ff41e4bb3e655307838781}] 2023-11-13 04:54:07,170 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(763): Validating hfile at hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231113/family1/15da03b766ff41e4bb3e655307838781 for inclusion in 90df22d5e18546f877e84e0c244138f5/family1 2023-11-13 04:54:07,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-11-13 04:54:07,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-13 04:54:07,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HRegion(2446): Flush status journal for 90df22d5e18546f877e84e0c244138f5: 2023-11-13 04:54:07,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231113/family1/15da03b766ff41e4bb3e655307838781 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testScannerOnBulkLoadRefHFiles__t04h4imiiipv6nfc2ejq7l6dncobm5jdac2u0rumegb6sjbf0hoedft7hdk9abkd/family1/15da03b766ff41e4bb3e655307838781 2023-11-13 04:54:07,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testScannerOnBulkLoadRefHFiles__t04h4imiiipv6nfc2ejq7l6dncobm5jdac2u0rumegb6sjbf0hoedft7hdk9abkd/family1/15da03b766ff41e4bb3e655307838781 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testScannerOnBulkLoadRefHFiles/90df22d5e18546f877e84e0c244138f5/family1/457f3bfbf8eb40378ff858cdae4c5d31_SeqId_12_ 2023-11-13 04:54:07,176 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(849): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testScannerOnBulkLoadRefHFiles__t04h4imiiipv6nfc2ejq7l6dncobm5jdac2u0rumegb6sjbf0hoedft7hdk9abkd/family1/15da03b766ff41e4bb3e655307838781 into 90df22d5e18546f877e84e0c244138f5/family1 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testScannerOnBulkLoadRefHFiles/90df22d5e18546f877e84e0c244138f5/family1/457f3bfbf8eb40378ff858cdae4c5d31_SeqId_12_ - updating store file list. 2023-11-13 04:54:07,180 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(882): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testScannerOnBulkLoadRefHFiles/90df22d5e18546f877e84e0c244138f5/family1/457f3bfbf8eb40378ff858cdae4c5d31_SeqId_12_ into 90df22d5e18546f877e84e0c244138f5/family1 2023-11-13 04:54:07,180 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(855): Successfully loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testScannerOnBulkLoadRefHFiles__t04h4imiiipv6nfc2ejq7l6dncobm5jdac2u0rumegb6sjbf0hoedft7hdk9abkd/family1/15da03b766ff41e4bb3e655307838781 into 90df22d5e18546f877e84e0c244138f5/family1 (new location: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testScannerOnBulkLoadRefHFiles/90df22d5e18546f877e84e0c244138f5/family1/457f3bfbf8eb40378ff858cdae4c5d31_SeqId_12_) 2023-11-13 04:54:07,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testScannerOnBulkLoadRefHFiles__t04h4imiiipv6nfc2ejq7l6dncobm5jdac2u0rumegb6sjbf0hoedft7hdk9abkd/family1/15da03b766ff41e4bb3e655307838781 2023-11-13 04:54:07,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-13 04:54:07,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-13 04:54:07,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(1912): 90df22d5e18546f877e84e0c244138f5/family1 is initiating minor compaction (all files) 2023-11-13 04:54:07,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@426f1145; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-13 04:54:07,181 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 90df22d5e18546f877e84e0c244138f5/family1 in testScannerOnBulkLoadRefHFiles,2,1699851242251.90df22d5e18546f877e84e0c244138f5. 2023-11-13 04:54:07,181 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testScannerOnBulkLoadRefHFiles/90df22d5e18546f877e84e0c244138f5/family1/edb37d45774240be9dd5db4c3ea7cb92, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testScannerOnBulkLoadRefHFiles/90df22d5e18546f877e84e0c244138f5/family1/266819d039cf4d0dae3c2b201ac0fe5e, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testScannerOnBulkLoadRefHFiles/90df22d5e18546f877e84e0c244138f5/family1/457f3bfbf8eb40378ff858cdae4c5d31_SeqId_12_] into tmpdir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testScannerOnBulkLoadRefHFiles/90df22d5e18546f877e84e0c244138f5/.tmp, totalSize=15.1 K 2023-11-13 04:54:07,182 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting edb37d45774240be9dd5db4c3ea7cb92, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699851244361 2023-11-13 04:54:07,183 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 266819d039cf4d0dae3c2b201ac0fe5e, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699851244361 2023-11-13 04:54:07,183 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231113 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-13 04:54:07,183 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 457f3bfbf8eb40378ff858cdae4c5d31_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699851244361 2023-11-13 04:54:07,184 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:54:07,185 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231113433bfb228ebb46b38fe053a5eb8d4648 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231113433bfb228ebb46b38fe053a5eb8d4648 2023-11-13 04:54:07,186 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231113f9141275fd1d4f88a1722e37758e2a8f to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231113f9141275fd1d4f88a1722e37758e2a8f 2023-11-13 04:54:07,186 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-11-13 04:54:07,186 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231113' 2023-11-13 04:54:07,187 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231113 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-11-13 04:54:07,187 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-13 04:54:07,187 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-13 04:54:07,188 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-13 04:54:07,189 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 891 msec 2023-11-13 04:54:07,192 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] throttle.PressureAwareThroughputController(145): 90df22d5e18546f877e84e0c244138f5#family1#compaction#37 average throughput is 0.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-13 04:54:07,219 INFO [Listener at localhost/34517] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=249 (was 260), OpenFileDescriptor=611 (was 653), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=184 (was 183) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=2544 (was 2590) 2023-11-13 04:54:07,230 INFO [Listener at localhost/34517] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=249, OpenFileDescriptor=611, MaxFileDescriptor=60000, SystemLoadAverage=184, ProcessCount=169, AvailableMemoryMB=2543 2023-11-13 04:54:07,232 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-13 04:54:07,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:07,234 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-13 04:54:07,234 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-11-13 04:54:07,235 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-13 04:54:07,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-13 04:54:07,236 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d 2023-11-13 04:54:07,237 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d empty. 2023-11-13 04:54:07,237 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d 2023-11-13 04:54:07,237 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-11-13 04:54:07,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-13 04:54:07,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-13 04:54:07,645 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-13 04:54:07,647 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 636529c4d3fc4ed9b0aa1a1d0c8a802d, NAME => 'testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp 2023-11-13 04:54:07,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-13 04:54:08,053 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-13 04:54:08,053 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing 636529c4d3fc4ed9b0aa1a1d0c8a802d, disabling compactions & flushes 2023-11-13 04:54:08,053 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d. 2023-11-13 04:54:08,053 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d. 2023-11-13 04:54:08,053 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d. after waiting 0 ms 2023-11-13 04:54:08,053 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d. 2023-11-13 04:54:08,053 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d. 2023-11-13 04:54:08,053 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 636529c4d3fc4ed9b0aa1a1d0c8a802d: 2023-11-13 04:54:08,055 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-13 04:54:08,056 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1699851248056"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699851248056"}]},"ts":"1699851248056"} 2023-11-13 04:54:08,058 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-13 04:54:08,059 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-13 04:54:08,059 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699851248059"}]},"ts":"1699851248059"} 2023-11-13 04:54:08,060 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-11-13 04:54:08,063 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=636529c4d3fc4ed9b0aa1a1d0c8a802d, ASSIGN}] 2023-11-13 04:54:08,064 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=636529c4d3fc4ed9b0aa1a1d0c8a802d, ASSIGN 2023-11-13 04:54:08,065 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=636529c4d3fc4ed9b0aa1a1d0c8a802d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41657,1699851201532; forceNewPlan=false, retain=false 2023-11-13 04:54:08,216 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=636529c4d3fc4ed9b0aa1a1d0c8a802d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:08,216 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1699851248216"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699851248216"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699851248216"}]},"ts":"1699851248216"} 2023-11-13 04:54:08,218 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure 636529c4d3fc4ed9b0aa1a1d0c8a802d, server=jenkins-hbase4.apache.org,41657,1699851201532}] 2023-11-13 04:54:08,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-13 04:54:08,369 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:08,372 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d. 2023-11-13 04:54:08,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 636529c4d3fc4ed9b0aa1a1d0c8a802d, NAME => 'testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d.', STARTKEY => '', ENDKEY => ''} 2023-11-13 04:54:08,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy 636529c4d3fc4ed9b0aa1a1d0c8a802d 2023-11-13 04:54:08,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-13 04:54:08,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 636529c4d3fc4ed9b0aa1a1d0c8a802d 2023-11-13 04:54:08,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 636529c4d3fc4ed9b0aa1a1d0c8a802d 2023-11-13 04:54:08,374 INFO [StoreOpener-636529c4d3fc4ed9b0aa1a1d0c8a802d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 636529c4d3fc4ed9b0aa1a1d0c8a802d 2023-11-13 04:54:08,375 DEBUG [StoreOpener-636529c4d3fc4ed9b0aa1a1d0c8a802d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1 2023-11-13 04:54:08,375 DEBUG [StoreOpener-636529c4d3fc4ed9b0aa1a1d0c8a802d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1 2023-11-13 04:54:08,375 INFO [StoreOpener-636529c4d3fc4ed9b0aa1a1d0c8a802d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 636529c4d3fc4ed9b0aa1a1d0c8a802d columnFamilyName family1 2023-11-13 04:54:08,377 INFO [StoreOpener-636529c4d3fc4ed9b0aa1a1d0c8a802d-1] regionserver.HStore(310): Store=636529c4d3fc4ed9b0aa1a1d0c8a802d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-13 04:54:08,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d 2023-11-13 04:54:08,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d 2023-11-13 04:54:08,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 636529c4d3fc4ed9b0aa1a1d0c8a802d 2023-11-13 04:54:08,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-13 04:54:08,383 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 636529c4d3fc4ed9b0aa1a1d0c8a802d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69355125, jitterRate=0.03347189724445343}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-13 04:54:08,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 636529c4d3fc4ed9b0aa1a1d0c8a802d: 2023-11-13 04:54:08,383 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d., pid=37, masterSystemTime=1699851248369 2023-11-13 04:54:08,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d. 2023-11-13 04:54:08,385 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d. 2023-11-13 04:54:08,385 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=636529c4d3fc4ed9b0aa1a1d0c8a802d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:08,385 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1699851248385"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699851248385"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699851248385"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699851248385"}]},"ts":"1699851248385"} 2023-11-13 04:54:08,388 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-11-13 04:54:08,388 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure 636529c4d3fc4ed9b0aa1a1d0c8a802d, server=jenkins-hbase4.apache.org,41657,1699851201532 in 169 msec 2023-11-13 04:54:08,389 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=36, resume processing ppid=35 2023-11-13 04:54:08,389 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=636529c4d3fc4ed9b0aa1a1d0c8a802d, ASSIGN in 325 msec 2023-11-13 04:54:08,390 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-13 04:54:08,390 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699851248390"}]},"ts":"1699851248390"} 2023-11-13 04:54:08,391 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-11-13 04:54:08,394 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-13 04:54:08,395 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 1.1620 sec 2023-11-13 04:54:08,411 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testScannerOnBulkLoadRefHFiles/90df22d5e18546f877e84e0c244138f5/.tmp/family1/985a83321e984609948853692950da06 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testScannerOnBulkLoadRefHFiles/90df22d5e18546f877e84e0c244138f5/family1/985a83321e984609948853692950da06 2023-11-13 04:54:08,416 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 90df22d5e18546f877e84e0c244138f5/family1 of 90df22d5e18546f877e84e0c244138f5 into 985a83321e984609948853692950da06(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-13 04:54:08,416 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 90df22d5e18546f877e84e0c244138f5: 2023-11-13 04:54:08,416 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1699851242251.90df22d5e18546f877e84e0c244138f5., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1699851247181; duration=1sec 2023-11-13 04:54:08,417 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-13 04:54:08,437 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testScannerOnBulkLoadRefHFiles/90df22d5e18546f877e84e0c244138f5/family1/edb37d45774240be9dd5db4c3ea7cb92, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testScannerOnBulkLoadRefHFiles/90df22d5e18546f877e84e0c244138f5/family1/266819d039cf4d0dae3c2b201ac0fe5e, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testScannerOnBulkLoadRefHFiles/90df22d5e18546f877e84e0c244138f5/family1/457f3bfbf8eb40378ff858cdae4c5d31_SeqId_12_] to archive 2023-11-13 04:54:08,438 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:54:08,439 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testScannerOnBulkLoadRefHFiles/90df22d5e18546f877e84e0c244138f5/family1/edb37d45774240be9dd5db4c3ea7cb92 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testScannerOnBulkLoadRefHFiles/90df22d5e18546f877e84e0c244138f5/family1/edb37d45774240be9dd5db4c3ea7cb92 2023-11-13 04:54:08,440 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testScannerOnBulkLoadRefHFiles/90df22d5e18546f877e84e0c244138f5/family1/266819d039cf4d0dae3c2b201ac0fe5e to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testScannerOnBulkLoadRefHFiles/90df22d5e18546f877e84e0c244138f5/family1/266819d039cf4d0dae3c2b201ac0fe5e 2023-11-13 04:54:08,441 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testScannerOnBulkLoadRefHFiles/90df22d5e18546f877e84e0c244138f5/family1/457f3bfbf8eb40378ff858cdae4c5d31_SeqId_12_ to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testScannerOnBulkLoadRefHFiles/90df22d5e18546f877e84e0c244138f5/family1/457f3bfbf8eb40378ff858cdae4c5d31_SeqId_12_ 2023-11-13 04:54:08,928 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-13 04:54:09,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-13 04:54:09,340 INFO [Listener at localhost/34517] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-11-13 04:54:09,367 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:54:09,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:09,369 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-13 04:54:09,369 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:09,369 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-13 04:54:09,369 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-13 04:54:09,370 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:09,370 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:09,372 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:09,372 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:09,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:09,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:09,372 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:09,372 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:54:09,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:09,373 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:09,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:54:09,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:09,373 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:09,373 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:09,373 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-13 04:54:09,373 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:09,373 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-13 04:54:09,374 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:54:09,374 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:54:09,374 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d. 2023-11-13 04:54:09,374 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d. started... 2023-11-13 04:54:09,374 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 636529c4d3fc4ed9b0aa1a1d0c8a802d 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-13 04:54:09,794 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130c7422809505644cdaf3ef4d385d9bc0b to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130c7422809505644cdaf3ef4d385d9bc0b 2023-11-13 04:54:10,198 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/.tmp/family1/fd6c196c52574b19861a2692bb2b9d86 2023-11-13 04:54:10,203 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/.tmp/family1/fd6c196c52574b19861a2692bb2b9d86 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/fd6c196c52574b19861a2692bb2b9d86 2023-11-13 04:54:10,207 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/fd6c196c52574b19861a2692bb2b9d86, entries=1000, sequenceid=5, filesize=165.1 K 2023-11-13 04:54:10,208 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 636529c4d3fc4ed9b0aa1a1d0c8a802d in 834ms, sequenceid=5, compaction requested=false 2023-11-13 04:54:10,208 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-11-13 04:54:10,209 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 636529c4d3fc4ed9b0aa1a1d0c8a802d: 2023-11-13 04:54:10,209 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d. 2023-11-13 04:54:10,209 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:54:10,209 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:54:10,209 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:10,209 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-13 04:54:10,209 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-13 04:54:10,211 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:10,211 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:10,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:10,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:10,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:10,211 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:10,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:10,211 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:54:10,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:10,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:10,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:10,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:10,212 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-13 04:54:10,212 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7cf1032[Count = 0] remaining members to acquire global barrier 2023-11-13 04:54:10,212 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-13 04:54:10,213 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:10,214 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:10,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:10,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:10,214 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-13 04:54:10,214 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-13 04:54:10,214 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:54:10,214 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:10,214 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:54:10,215 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:10,215 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-13 04:54:10,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:10,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:10,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:10,215 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:10,216 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-13 04:54:10,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:10,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:10,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:10,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:10,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:10,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:10,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:10,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:54:10,218 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-13 04:54:10,218 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-13 04:54:10,218 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:54:10,218 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:54:10,218 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:10,218 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:54:10,221 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:10,221 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:10,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:10,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:10,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:10,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:10,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:10,221 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:10,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:10,221 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:10,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:10,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:10,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:10,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:10,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:10,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:10,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:10,223 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:10,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:10,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:10,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:10,225 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:10,225 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:10,225 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:10,225 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:10,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:10,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:10,225 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-13 04:54:10,225 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:54:10,225 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:10,225 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:10,225 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:10,225 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:10,225 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-13 04:54:10,226 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:10,226 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-13 04:54:10,226 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:10,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:10,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:10,226 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:54:10,326 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:54:10,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:54:10,331 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:54:10,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-13 04:54:10,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:10,333 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-13 04:54:10,333 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:10,333 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-13 04:54:10,333 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-13 04:54:10,333 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:10,333 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:10,335 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:10,335 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:10,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:10,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:10,335 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:10,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:10,335 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:54:10,335 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:10,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:54:10,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:10,336 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:10,336 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-13 04:54:10,336 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:10,336 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-13 04:54:10,336 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:10,336 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-13 04:54:10,336 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:54:10,336 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:54:10,336 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d. 2023-11-13 04:54:10,336 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d. started... 2023-11-13 04:54:10,337 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 636529c4d3fc4ed9b0aa1a1d0c8a802d 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-13 04:54:10,750 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511281acfc129df554dd3a3e9e9baf28ff64d to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511281acfc129df554dd3a3e9e9baf28ff64d 2023-11-13 04:54:11,155 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/.tmp/family1/8001c6cf5bac43fe9002bf0083b143fb 2023-11-13 04:54:11,160 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/.tmp/family1/8001c6cf5bac43fe9002bf0083b143fb as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/8001c6cf5bac43fe9002bf0083b143fb 2023-11-13 04:54:11,164 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/8001c6cf5bac43fe9002bf0083b143fb, entries=1, sequenceid=9, filesize=5.0 K 2023-11-13 04:54:11,165 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 636529c4d3fc4ed9b0aa1a1d0c8a802d in 829ms, sequenceid=9, compaction requested=false 2023-11-13 04:54:11,165 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 636529c4d3fc4ed9b0aa1a1d0c8a802d: 2023-11-13 04:54:11,165 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d. 2023-11-13 04:54:11,165 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:54:11,165 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:54:11,165 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:11,166 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-13 04:54:11,166 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-13 04:54:11,167 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:11,167 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:11,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:11,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:11,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:11,168 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:11,168 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:54:11,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:11,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:11,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:11,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:11,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:11,169 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-13 04:54:11,169 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@547d2c2c[Count = 0] remaining members to acquire global barrier 2023-11-13 04:54:11,169 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-13 04:54:11,169 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:11,171 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:11,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:11,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:11,171 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-13 04:54:11,171 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-13 04:54:11,171 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:54:11,171 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:11,171 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:54:11,173 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-13 04:54:11,173 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:11,173 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:11,173 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-13 04:54:11,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:11,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:11,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:11,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:11,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:11,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:11,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:11,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:11,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:11,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:11,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:54:11,175 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-13 04:54:11,175 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-13 04:54:11,175 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:54:11,175 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:54:11,175 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:11,175 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:54:11,177 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:11,177 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:11,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:11,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:11,177 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:11,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:11,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:11,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:11,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:11,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:11,178 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:11,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:11,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:11,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:11,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:11,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:11,179 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:11,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:11,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:11,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:11,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:11,184 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:11,184 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:11,184 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:11,184 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:11,184 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:11,184 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:11,184 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-13 04:54:11,184 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:11,184 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-13 04:54:11,185 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:54:11,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:11,184 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:11,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:11,185 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:11,185 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:11,185 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-13 04:54:11,185 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:54:11,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:11,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:11,285 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:54:11,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:54:11,289 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:54:11,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-13 04:54:11,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:11,291 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-13 04:54:11,291 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:11,291 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-13 04:54:11,291 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-13 04:54:11,291 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:11,292 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:11,293 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:11,293 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:11,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:11,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:11,293 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:11,293 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:54:11,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:11,294 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:11,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:54:11,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:11,294 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:11,294 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-13 04:54:11,294 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:11,294 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-13 04:54:11,294 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:11,294 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-13 04:54:11,295 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:54:11,295 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:54:11,295 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d. 2023-11-13 04:54:11,295 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d. started... 2023-11-13 04:54:11,295 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 636529c4d3fc4ed9b0aa1a1d0c8a802d 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:54:11,707 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120124ac7e3226c247b5a928bd471a7db9c5 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015120124ac7e3226c247b5a928bd471a7db9c5 2023-11-13 04:54:12,112 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/.tmp/family1/211c51481f3f45ea839006e7ba5c8079 2023-11-13 04:54:12,117 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/.tmp/family1/211c51481f3f45ea839006e7ba5c8079 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/211c51481f3f45ea839006e7ba5c8079 2023-11-13 04:54:12,122 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/211c51481f3f45ea839006e7ba5c8079, entries=1, sequenceid=13, filesize=4.9 K 2023-11-13 04:54:12,122 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 636529c4d3fc4ed9b0aa1a1d0c8a802d in 827ms, sequenceid=13, compaction requested=true 2023-11-13 04:54:12,123 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 636529c4d3fc4ed9b0aa1a1d0c8a802d: 2023-11-13 04:54:12,123 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d. 2023-11-13 04:54:12,123 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:54:12,123 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:54:12,123 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:12,123 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-13 04:54:12,123 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-13 04:54:12,125 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:12,125 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:12,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:12,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:12,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:12,125 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:12,125 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:54:12,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:12,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:12,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:12,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:12,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:12,126 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-13 04:54:12,126 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@708391d9[Count = 0] remaining members to acquire global barrier 2023-11-13 04:54:12,126 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-13 04:54:12,126 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:12,128 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:12,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:12,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:12,128 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-13 04:54:12,128 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-13 04:54:12,128 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:54:12,128 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:12,128 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:54:12,130 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:12,130 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-13 04:54:12,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:12,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:12,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:12,130 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:12,130 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-13 04:54:12,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:12,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:12,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:12,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:12,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:12,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:12,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:12,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:54:12,132 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-13 04:54:12,132 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-13 04:54:12,132 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:54:12,132 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:54:12,132 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:12,132 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:54:12,134 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:12,134 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:12,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:12,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:12,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:12,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:12,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:12,134 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:12,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:12,135 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:12,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:12,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:12,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:12,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:12,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:12,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:12,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:12,136 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:12,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:12,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:12,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:12,138 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:12,138 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:12,138 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:12,138 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:12,138 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:12,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-13 04:54:12,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:54:12,138 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:12,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:12,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:12,138 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:12,138 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:12,138 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-13 04:54:12,138 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-13 04:54:12,138 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:12,138 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:54:12,138 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:12,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:12,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:12,239 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:54:12,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:54:12,243 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:54:12,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-13 04:54:12,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:12,244 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-13 04:54:12,245 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:12,245 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-13 04:54:12,245 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-13 04:54:12,245 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:12,245 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:12,252 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:12,252 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:12,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:12,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:12,252 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:12,252 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:54:12,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:12,253 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:12,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:54:12,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:12,253 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:12,253 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-13 04:54:12,253 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:12,253 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-13 04:54:12,253 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:12,253 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-13 04:54:12,253 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:54:12,254 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:54:12,254 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d. 2023-11-13 04:54:12,254 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d. started... 2023-11-13 04:54:12,254 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 636529c4d3fc4ed9b0aa1a1d0c8a802d 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:54:12,666 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205058c84e2e8b94d3493fcaff8d519d8b6 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205058c84e2e8b94d3493fcaff8d519d8b6 2023-11-13 04:54:13,072 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/.tmp/family1/e0f74825ef7b44369ed4c96755464cc9 2023-11-13 04:54:13,077 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/.tmp/family1/e0f74825ef7b44369ed4c96755464cc9 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/e0f74825ef7b44369ed4c96755464cc9 2023-11-13 04:54:13,081 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/e0f74825ef7b44369ed4c96755464cc9, entries=1, sequenceid=17, filesize=4.9 K 2023-11-13 04:54:13,082 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 636529c4d3fc4ed9b0aa1a1d0c8a802d in 828ms, sequenceid=17, compaction requested=true 2023-11-13 04:54:13,082 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 636529c4d3fc4ed9b0aa1a1d0c8a802d: 2023-11-13 04:54:13,082 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d. 2023-11-13 04:54:13,083 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:54:13,083 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:54:13,083 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:13,083 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-13 04:54:13,083 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-13 04:54:13,085 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:13,085 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:13,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:13,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:13,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:13,085 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:13,085 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:54:13,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:13,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:13,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:13,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:13,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:13,086 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-13 04:54:13,086 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56af8f3f[Count = 0] remaining members to acquire global barrier 2023-11-13 04:54:13,087 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-13 04:54:13,087 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:13,088 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:13,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:13,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:13,088 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-13 04:54:13,088 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-13 04:54:13,088 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:54:13,088 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:13,088 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:54:13,089 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:13,089 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-13 04:54:13,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:13,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:13,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:13,089 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:13,089 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-13 04:54:13,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:13,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:13,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:13,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:13,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:13,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:13,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:13,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:54:13,092 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-13 04:54:13,092 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-13 04:54:13,092 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:54:13,092 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:54:13,092 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:13,092 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:54:13,094 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:13,094 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:13,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:13,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:13,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:13,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:13,094 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:13,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:13,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:13,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:13,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:13,095 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:13,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:13,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:13,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:13,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:13,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:13,096 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:13,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:13,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:13,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:13,098 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:13,098 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:13,098 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:13,098 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:13,098 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:13,099 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:13,099 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:13,099 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-13 04:54:13,099 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:13,099 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:13,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:13,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:13,099 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-13 04:54:13,099 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:54:13,099 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:13,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:13,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:13,099 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-13 04:54:13,099 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:54:13,199 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:54:13,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:54:13,204 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:54:13,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-13 04:54:13,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:13,206 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-13 04:54:13,206 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:13,206 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-13 04:54:13,206 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-13 04:54:13,206 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:13,206 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:13,207 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:13,207 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:13,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:13,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:13,208 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:13,208 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:54:13,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:13,208 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:13,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:54:13,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:13,208 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:13,209 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-13 04:54:13,209 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:13,209 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-13 04:54:13,209 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:13,209 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-13 04:54:13,209 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:54:13,209 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:54:13,209 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d. 2023-11-13 04:54:13,209 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d. started... 2023-11-13 04:54:13,209 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 636529c4d3fc4ed9b0aa1a1d0c8a802d 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:54:13,622 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228f6e8a856703c46aebbeb2322d4f0924f to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228f6e8a856703c46aebbeb2322d4f0924f 2023-11-13 04:54:13,874 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-13 04:54:14,027 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/.tmp/family1/c18d7ff1f5ad4bd5852c1e27ae37e616 2023-11-13 04:54:14,032 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/.tmp/family1/c18d7ff1f5ad4bd5852c1e27ae37e616 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/c18d7ff1f5ad4bd5852c1e27ae37e616 2023-11-13 04:54:14,036 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/c18d7ff1f5ad4bd5852c1e27ae37e616, entries=1, sequenceid=21, filesize=4.9 K 2023-11-13 04:54:14,036 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 636529c4d3fc4ed9b0aa1a1d0c8a802d in 827ms, sequenceid=21, compaction requested=true 2023-11-13 04:54:14,036 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 636529c4d3fc4ed9b0aa1a1d0c8a802d: 2023-11-13 04:54:14,037 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d. 2023-11-13 04:54:14,037 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:54:14,037 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:54:14,037 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:14,037 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-13 04:54:14,037 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-13 04:54:14,039 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:14,039 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:14,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:14,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:14,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:14,039 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:14,039 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:54:14,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:14,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:14,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:14,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:14,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:14,040 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-13 04:54:14,040 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@291e4b58[Count = 0] remaining members to acquire global barrier 2023-11-13 04:54:14,040 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-13 04:54:14,040 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:14,042 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:14,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:14,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:14,042 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-13 04:54:14,042 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-13 04:54:14,042 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:54:14,043 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:14,043 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:54:14,044 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-13 04:54:14,044 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:14,044 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:14,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:14,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:14,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:14,044 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-13 04:54:14,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:14,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:14,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:14,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:14,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:14,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:14,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:14,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:54:14,047 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-13 04:54:14,047 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-13 04:54:14,047 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:54:14,047 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:54:14,047 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:14,047 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:54:14,051 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:14,051 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:14,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:14,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:14,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:14,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:14,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:14,051 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:14,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:14,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:14,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:14,052 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:14,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:14,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:14,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:14,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:14,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:14,053 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:14,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:14,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:14,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:14,057 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:14,057 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:14,057 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:14,057 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:14,057 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:14,057 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:14,057 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-13 04:54:14,057 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:54:14,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:14,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:14,057 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:14,057 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:14,057 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:14,057 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:14,057 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-13 04:54:14,057 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:54:14,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:14,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:14,158 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:54:14,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:54:14,162 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:54:14,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-13 04:54:14,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:14,163 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-13 04:54:14,163 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:14,164 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-13 04:54:14,164 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-13 04:54:14,164 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:14,164 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:14,165 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:14,165 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:14,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:14,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:14,166 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:14,166 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:54:14,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:14,166 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:14,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:54:14,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:14,166 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:14,167 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-13 04:54:14,167 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:14,167 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-13 04:54:14,167 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:14,167 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-13 04:54:14,167 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:54:14,167 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:54:14,167 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d. 2023-11-13 04:54:14,167 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d. started... 2023-11-13 04:54:14,167 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 636529c4d3fc4ed9b0aa1a1d0c8a802d 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:54:14,581 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512311839e70d39c2454fbe1418348b1a3703 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512311839e70d39c2454fbe1418348b1a3703 2023-11-13 04:54:14,986 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/.tmp/family1/19b9c0cdf0a6496686bda0ef02bc5a9b 2023-11-13 04:54:14,991 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/.tmp/family1/19b9c0cdf0a6496686bda0ef02bc5a9b as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/19b9c0cdf0a6496686bda0ef02bc5a9b 2023-11-13 04:54:14,995 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/19b9c0cdf0a6496686bda0ef02bc5a9b, entries=1, sequenceid=25, filesize=4.9 K 2023-11-13 04:54:14,996 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 636529c4d3fc4ed9b0aa1a1d0c8a802d in 829ms, sequenceid=25, compaction requested=true 2023-11-13 04:54:14,996 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 636529c4d3fc4ed9b0aa1a1d0c8a802d: 2023-11-13 04:54:14,996 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d. 2023-11-13 04:54:14,996 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:54:14,996 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:54:14,996 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:14,996 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-13 04:54:14,996 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-13 04:54:14,998 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:14,998 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:14,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:14,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:14,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:14,998 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:14,998 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:54:14,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:14,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:14,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:14,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:14,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:15,000 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-13 04:54:15,000 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@143f0e1b[Count = 0] remaining members to acquire global barrier 2023-11-13 04:54:15,000 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-13 04:54:15,000 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:15,001 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:15,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:15,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:15,001 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-13 04:54:15,001 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-13 04:54:15,001 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:54:15,001 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:15,001 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:54:15,003 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-13 04:54:15,003 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:15,003 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:15,003 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-13 04:54:15,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:15,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:15,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:15,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:15,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:15,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:15,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:15,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:15,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:15,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:15,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:54:15,006 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-13 04:54:15,006 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-13 04:54:15,006 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:54:15,006 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:54:15,006 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:15,006 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:54:15,007 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:15,007 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:15,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:15,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:15,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:15,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:15,007 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:15,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:15,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:15,008 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:15,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:15,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:15,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:15,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:15,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:15,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:15,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:15,009 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:15,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:15,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:15,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:15,011 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:15,012 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:15,012 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:15,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:15,012 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:15,012 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:15,012 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:15,012 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:15,012 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-13 04:54:15,012 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:54:15,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:15,012 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:15,012 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:15,012 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:15,012 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-13 04:54:15,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:15,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:15,012 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:54:15,112 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:54:15,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:54:15,117 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:54:15,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-13 04:54:15,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:15,119 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-13 04:54:15,119 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:15,119 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-13 04:54:15,119 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-13 04:54:15,119 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:15,119 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:15,121 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:15,121 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:15,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:15,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:15,121 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:15,121 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:54:15,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:15,121 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:15,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:54:15,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:15,122 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:15,122 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-13 04:54:15,122 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:15,122 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-13 04:54:15,122 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:15,122 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-13 04:54:15,122 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:54:15,122 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:54:15,122 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d. 2023-11-13 04:54:15,122 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d. started... 2023-11-13 04:54:15,123 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 636529c4d3fc4ed9b0aa1a1d0c8a802d 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:54:15,535 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601017706298d1c31409a93be440cdddba65d to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601017706298d1c31409a93be440cdddba65d 2023-11-13 04:54:15,941 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/.tmp/family1/5c5be18953a940dea3738e53ae25fe93 2023-11-13 04:54:15,946 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/.tmp/family1/5c5be18953a940dea3738e53ae25fe93 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/5c5be18953a940dea3738e53ae25fe93 2023-11-13 04:54:15,950 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/5c5be18953a940dea3738e53ae25fe93, entries=1, sequenceid=29, filesize=4.9 K 2023-11-13 04:54:15,950 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 636529c4d3fc4ed9b0aa1a1d0c8a802d in 827ms, sequenceid=29, compaction requested=true 2023-11-13 04:54:15,950 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 636529c4d3fc4ed9b0aa1a1d0c8a802d: 2023-11-13 04:54:15,950 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d. 2023-11-13 04:54:15,950 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:54:15,951 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:54:15,951 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:15,951 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-13 04:54:15,951 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-13 04:54:15,953 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:15,953 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:15,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:15,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:15,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:15,954 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:15,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:15,954 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:54:15,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:15,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:15,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:15,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:15,955 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-13 04:54:15,955 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78de481c[Count = 0] remaining members to acquire global barrier 2023-11-13 04:54:15,955 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-13 04:54:15,955 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:15,956 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:15,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:15,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:15,957 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-13 04:54:15,957 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-13 04:54:15,957 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:54:15,957 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:15,957 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:54:15,958 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:15,958 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-13 04:54:15,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:15,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:15,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:15,958 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:15,958 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-13 04:54:15,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:15,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:15,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:15,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:15,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:15,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:15,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:15,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:54:15,961 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-13 04:54:15,961 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-13 04:54:15,961 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:54:15,961 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:54:15,961 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:15,961 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:54:15,962 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:15,962 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:15,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:15,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:15,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:15,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:15,962 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:15,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:15,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:15,963 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:15,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:15,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:15,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:15,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:15,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:15,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:15,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:15,964 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:15,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:15,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:15,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:15,967 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:15,967 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:15,967 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:15,967 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:15,967 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:15,967 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:15,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:15,967 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:15,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:15,967 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-13 04:54:15,968 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:54:15,967 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:15,967 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:15,968 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:15,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:15,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:15,968 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-13 04:54:15,968 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:54:16,068 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:54:16,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:54:16,073 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:54:16,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-13 04:54:16,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:16,074 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-13 04:54:16,074 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:16,074 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-13 04:54:16,074 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-13 04:54:16,075 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:16,075 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:16,076 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:16,076 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:16,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:16,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:16,077 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:16,077 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:54:16,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:16,077 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:16,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:54:16,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:16,078 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:16,078 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-13 04:54:16,078 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:16,078 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-13 04:54:16,078 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:16,078 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-13 04:54:16,078 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:54:16,078 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:54:16,078 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d. 2023-11-13 04:54:16,078 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d. started... 2023-11-13 04:54:16,078 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 636529c4d3fc4ed9b0aa1a1d0c8a802d 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:54:16,491 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103907986edb7a341b1afc204586e5972fe to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103907986edb7a341b1afc204586e5972fe 2023-11-13 04:54:16,896 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/.tmp/family1/4eddd0d95a9f4ffd9d4d6e4bdbdd499b 2023-11-13 04:54:16,901 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/.tmp/family1/4eddd0d95a9f4ffd9d4d6e4bdbdd499b as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/4eddd0d95a9f4ffd9d4d6e4bdbdd499b 2023-11-13 04:54:16,905 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/4eddd0d95a9f4ffd9d4d6e4bdbdd499b, entries=1, sequenceid=33, filesize=4.9 K 2023-11-13 04:54:16,906 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 636529c4d3fc4ed9b0aa1a1d0c8a802d in 828ms, sequenceid=33, compaction requested=true 2023-11-13 04:54:16,906 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 636529c4d3fc4ed9b0aa1a1d0c8a802d: 2023-11-13 04:54:16,906 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d. 2023-11-13 04:54:16,906 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:54:16,906 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:54:16,906 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:16,906 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-13 04:54:16,906 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-13 04:54:16,908 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:16,908 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:16,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:16,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:16,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:16,908 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:16,908 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:54:16,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:16,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:16,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:16,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:16,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:16,910 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-13 04:54:16,910 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5222e64f[Count = 0] remaining members to acquire global barrier 2023-11-13 04:54:16,910 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-13 04:54:16,910 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:16,914 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:16,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:16,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:16,914 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-13 04:54:16,914 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-13 04:54:16,914 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:54:16,914 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:16,914 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:54:16,916 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-13 04:54:16,916 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:16,916 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:16,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:16,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:16,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:16,916 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-13 04:54:16,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:16,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:16,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:16,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:16,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:16,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:16,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:16,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:54:16,918 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-13 04:54:16,918 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-13 04:54:16,918 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:54:16,918 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:54:16,918 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:16,918 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:54:16,920 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:16,920 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:16,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:16,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:16,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:16,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:16,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:16,920 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:16,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:16,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:16,921 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:16,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:16,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:16,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:16,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:16,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:16,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:16,922 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:16,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:16,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:16,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:16,925 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:16,925 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:16,925 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:16,925 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:16,925 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:16,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:16,925 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-13 04:54:16,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:16,925 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-13 04:54:16,925 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:54:16,925 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:16,925 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:16,925 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:16,925 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:16,925 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:16,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:16,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:16,925 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-13 04:54:16,925 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:54:17,026 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:54:17,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:54:17,031 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:54:17,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-13 04:54:17,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:17,032 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-13 04:54:17,032 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:17,032 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-13 04:54:17,033 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-13 04:54:17,033 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:17,033 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:17,034 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:17,034 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:17,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:17,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:17,035 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:17,035 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:54:17,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:17,035 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:17,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:54:17,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:17,035 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:17,036 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-13 04:54:17,036 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:17,036 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-13 04:54:17,036 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:17,036 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-13 04:54:17,036 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:54:17,036 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:54:17,036 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d. 2023-11-13 04:54:17,036 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d. started... 2023-11-13 04:54:17,036 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 636529c4d3fc4ed9b0aa1a1d0c8a802d 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:54:17,449 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907a1a48c9da279412095197f1cd07440d8 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20150907a1a48c9da279412095197f1cd07440d8 2023-11-13 04:54:17,855 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/.tmp/family1/07e0119476df464cae2454920e05f0d2 2023-11-13 04:54:17,859 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/.tmp/family1/07e0119476df464cae2454920e05f0d2 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/07e0119476df464cae2454920e05f0d2 2023-11-13 04:54:17,863 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/07e0119476df464cae2454920e05f0d2, entries=1, sequenceid=37, filesize=4.9 K 2023-11-13 04:54:17,864 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 636529c4d3fc4ed9b0aa1a1d0c8a802d in 828ms, sequenceid=37, compaction requested=true 2023-11-13 04:54:17,864 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 636529c4d3fc4ed9b0aa1a1d0c8a802d: 2023-11-13 04:54:17,864 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d. 2023-11-13 04:54:17,864 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:54:17,864 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:54:17,864 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:17,864 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-13 04:54:17,864 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-13 04:54:17,867 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:17,867 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:17,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:17,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:17,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:17,867 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:17,867 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:54:17,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:17,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:17,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:17,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:17,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:17,869 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-13 04:54:17,869 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-13 04:54:17,869 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@93d23d8[Count = 0] remaining members to acquire global barrier 2023-11-13 04:54:17,869 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:17,870 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:17,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:17,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:17,870 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-13 04:54:17,870 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-13 04:54:17,870 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:54:17,870 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:17,870 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:54:17,872 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:17,872 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-13 04:54:17,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:17,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:17,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:17,872 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:17,872 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-13 04:54:17,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:17,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:17,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:17,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:17,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:17,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:17,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:17,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:54:17,874 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-13 04:54:17,874 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-13 04:54:17,874 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:54:17,874 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:54:17,874 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:17,874 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:54:17,876 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:17,876 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:17,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:17,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:17,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:17,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:17,876 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:17,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:17,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:17,877 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:17,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:17,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:17,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:17,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:17,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:17,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:17,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:17,878 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:17,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:17,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:17,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:17,881 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:17,881 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:17,881 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:17,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:17,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:17,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-13 04:54:17,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:54:17,882 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-13 04:54:17,882 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:17,882 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:17,882 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:17,882 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:17,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:17,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:17,882 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:17,882 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-13 04:54:17,882 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:54:17,882 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:17,882 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:17,982 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:54:17,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:54:17,987 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:54:17,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-13 04:54:17,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:17,989 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-13 04:54:17,989 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:17,989 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-13 04:54:17,989 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-13 04:54:17,989 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:17,989 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:17,990 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:17,990 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:17,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:17,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:17,991 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:17,991 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:54:17,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:17,991 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:17,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:54:17,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:17,992 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:17,992 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-13 04:54:17,992 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:17,992 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-13 04:54:17,992 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:17,992 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-13 04:54:17,992 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:54:17,992 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:54:17,992 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d. 2023-11-13 04:54:17,992 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d. started... 2023-11-13 04:54:17,992 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 636529c4d3fc4ed9b0aa1a1d0c8a802d 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:54:18,405 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511206812847b6f3c4c82bb2adea7187f3e84 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511206812847b6f3c4c82bb2adea7187f3e84 2023-11-13 04:54:18,811 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/.tmp/family1/e20be62c3cbc47b4b416ae1dc7bb0932 2023-11-13 04:54:18,815 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/.tmp/family1/e20be62c3cbc47b4b416ae1dc7bb0932 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/e20be62c3cbc47b4b416ae1dc7bb0932 2023-11-13 04:54:18,819 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/e20be62c3cbc47b4b416ae1dc7bb0932, entries=1, sequenceid=41, filesize=4.9 K 2023-11-13 04:54:18,820 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 636529c4d3fc4ed9b0aa1a1d0c8a802d in 828ms, sequenceid=41, compaction requested=true 2023-11-13 04:54:18,820 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 636529c4d3fc4ed9b0aa1a1d0c8a802d: 2023-11-13 04:54:18,820 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d. 2023-11-13 04:54:18,820 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:54:18,820 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:54:18,820 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:18,820 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-13 04:54:18,820 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-13 04:54:18,822 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:18,822 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:18,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:18,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:18,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:18,823 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:18,823 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:54:18,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:18,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:18,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:18,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:18,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:18,824 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-13 04:54:18,824 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@651ebb32[Count = 0] remaining members to acquire global barrier 2023-11-13 04:54:18,824 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-13 04:54:18,824 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:18,826 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:18,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:18,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:18,826 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-13 04:54:18,826 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-13 04:54:18,826 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:54:18,826 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:18,826 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:54:18,829 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-13 04:54:18,829 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:18,829 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:18,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:18,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:18,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:18,829 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-13 04:54:18,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:18,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:18,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:18,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:18,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:18,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:18,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:18,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:54:18,832 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-13 04:54:18,832 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-13 04:54:18,832 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:54:18,832 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:54:18,832 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:18,832 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:54:18,833 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:18,833 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:18,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:18,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:18,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:18,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:18,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:18,833 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:18,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:18,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:18,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:18,834 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:18,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:18,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:18,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:18,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:18,835 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:18,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:18,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:18,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:18,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:18,840 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:18,841 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:18,841 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:18,841 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:18,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:18,841 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:18,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-13 04:54:18,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:18,841 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:18,841 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:18,841 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:18,841 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:18,841 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:18,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:54:18,841 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-13 04:54:18,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:18,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:18,841 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-13 04:54:18,841 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:54:18,941 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:54:18,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:54:18,943 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33831] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-11-13 04:54:18,945 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] procedure2.ProcedureExecutor(1028): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-13 04:54:18,946 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-13 04:54:18,946 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-13 04:54:18,946 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699851858946 2023-11-13 04:54:18,949 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-13 04:54:18,950 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-11-13 04:54:18,950 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-13 04:54:18,951 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] zookeeper.ReadOnlyZKClient(139): Connect 0x18adca1a to 127.0.0.1:51072 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-13 04:54:18,957 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73d3e8f3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-13 04:54:18,958 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-13 04:54:19,399 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601035ca5124551064aa9bb6ade53c7edc6d9 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601035ca5124551064aa9bb6ade53c7edc6d9 2023-11-13 04:54:19,400 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-13 04:54:19,417 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-13 04:54:19,418 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56012, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-13 04:54:19,425 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-13 04:54:19,426 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54094, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-13 04:54:19,435 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/19cf1ce272e44387a6afe1ccfc83de12 first=Optional[r3] last=Optional[r6] 2023-11-13 04:54:19,436 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d., hostname=jenkins-hbase4.apache.org,41657,1699851201532, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/19cf1ce272e44387a6afe1ccfc83de12}] 2023-11-13 04:54:19,440 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(763): Validating hfile at hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/19cf1ce272e44387a6afe1ccfc83de12 for inclusion in 636529c4d3fc4ed9b0aa1a1d0c8a802d/family1 2023-11-13 04:54:19,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-13 04:54:19,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(777): Region bounds: first= last= 2023-11-13 04:54:19,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HRegion(2446): Flush status journal for 636529c4d3fc4ed9b0aa1a1d0c8a802d: 2023-11-13 04:54:19,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/19cf1ce272e44387a6afe1ccfc83de12 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithWeeklyPolicy__crffma5k07b6k0vp7d0f8ba79mjcb9rvv3flqcbl97o10gvs25se79k7cpkpef9p/family1/19cf1ce272e44387a6afe1ccfc83de12 2023-11-13 04:54:19,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithWeeklyPolicy__crffma5k07b6k0vp7d0f8ba79mjcb9rvv3flqcbl97o10gvs25se79k7cpkpef9p/family1/19cf1ce272e44387a6afe1ccfc83de12 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/92549902fb9c4bdba93e009dd14dff80_SeqId_44_ 2023-11-13 04:54:19,446 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(849): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithWeeklyPolicy__crffma5k07b6k0vp7d0f8ba79mjcb9rvv3flqcbl97o10gvs25se79k7cpkpef9p/family1/19cf1ce272e44387a6afe1ccfc83de12 into 636529c4d3fc4ed9b0aa1a1d0c8a802d/family1 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/92549902fb9c4bdba93e009dd14dff80_SeqId_44_ - updating store file list. 2023-11-13 04:54:19,450 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(882): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/92549902fb9c4bdba93e009dd14dff80_SeqId_44_ into 636529c4d3fc4ed9b0aa1a1d0c8a802d/family1 2023-11-13 04:54:19,450 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(855): Successfully loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithWeeklyPolicy__crffma5k07b6k0vp7d0f8ba79mjcb9rvv3flqcbl97o10gvs25se79k7cpkpef9p/family1/19cf1ce272e44387a6afe1ccfc83de12 into 636529c4d3fc4ed9b0aa1a1d0c8a802d/family1 (new location: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/92549902fb9c4bdba93e009dd14dff80_SeqId_44_) 2023-11-13 04:54:19,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithWeeklyPolicy__crffma5k07b6k0vp7d0f8ba79mjcb9rvv3flqcbl97o10gvs25se79k7cpkpef9p/family1/19cf1ce272e44387a6afe1ccfc83de12 2023-11-13 04:54:19,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-13 04:54:19,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-13 04:54:19,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(1912): 636529c4d3fc4ed9b0aa1a1d0c8a802d/family1 is initiating minor compaction 2023-11-13 04:54:19,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3833ff5; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-13 04:54:19,454 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 636529c4d3fc4ed9b0aa1a1d0c8a802d/family1 in testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d. 2023-11-13 04:54:19,454 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/8001c6cf5bac43fe9002bf0083b143fb, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/211c51481f3f45ea839006e7ba5c8079, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/e0f74825ef7b44369ed4c96755464cc9, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/c18d7ff1f5ad4bd5852c1e27ae37e616, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/19b9c0cdf0a6496686bda0ef02bc5a9b, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/5c5be18953a940dea3738e53ae25fe93, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/4eddd0d95a9f4ffd9d4d6e4bdbdd499b, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/07e0119476df464cae2454920e05f0d2, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/e20be62c3cbc47b4b416ae1dc7bb0932, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/92549902fb9c4bdba93e009dd14dff80_SeqId_44_] into tmpdir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/.tmp, totalSize=50.0 K 2023-11-13 04:54:19,454 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 8001c6cf5bac43fe9002bf0083b143fb, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-13 04:54:19,454 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 211c51481f3f45ea839006e7ba5c8079, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-13 04:54:19,454 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting e0f74825ef7b44369ed4c96755464cc9, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-13 04:54:19,454 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting c18d7ff1f5ad4bd5852c1e27ae37e616, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-13 04:54:19,454 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 19b9c0cdf0a6496686bda0ef02bc5a9b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-13 04:54:19,454 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 5c5be18953a940dea3738e53ae25fe93, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-13 04:54:19,454 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 4eddd0d95a9f4ffd9d4d6e4bdbdd499b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-13 04:54:19,454 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 07e0119476df464cae2454920e05f0d2, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-13 04:54:19,455 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting e20be62c3cbc47b4b416ae1dc7bb0932, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-13 04:54:19,455 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 92549902fb9c4bdba93e009dd14dff80_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-13 04:54:19,456 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-13 04:54:19,456 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:54:19,459 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228f6e8a856703c46aebbeb2322d4f0924f to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228f6e8a856703c46aebbeb2322d4f0924f 2023-11-13 04:54:19,460 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512311839e70d39c2454fbe1418348b1a3703 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512311839e70d39c2454fbe1418348b1a3703 2023-11-13 04:54:19,462 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601017706298d1c31409a93be440cdddba65d to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601017706298d1c31409a93be440cdddba65d 2023-11-13 04:54:19,463 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103907986edb7a341b1afc204586e5972fe to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103907986edb7a341b1afc204586e5972fe 2023-11-13 04:54:19,463 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-11-13 04:54:19,463 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-13 04:54:19,464 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-13 04:54:19,464 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-13 04:54:19,464 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-13 04:54:19,464 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-13 04:54:19,464 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-13 04:54:19,464 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-13 04:54:19,464 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-13 04:54:19,464 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-13 04:54:19,492 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] throttle.PressureAwareThroughputController(145): 636529c4d3fc4ed9b0aa1a1d0c8a802d#family1#compaction#48 average throughput is 1.36 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-13 04:54:20,309 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/.tmp/family1/cbd95510fe6b4426acd293e80d668098 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/cbd95510fe6b4426acd293e80d668098 2023-11-13 04:54:20,315 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 636529c4d3fc4ed9b0aa1a1d0c8a802d/family1 of 636529c4d3fc4ed9b0aa1a1d0c8a802d into cbd95510fe6b4426acd293e80d668098(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-13 04:54:20,315 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 636529c4d3fc4ed9b0aa1a1d0c8a802d: 2023-11-13 04:54:20,315 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1699851259454; duration=0sec 2023-11-13 04:54:20,315 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-13 04:54:20,321 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205232ab84acc2948548630c5cbcffbcc3f to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205232ab84acc2948548630c5cbcffbcc3f 2023-11-13 04:54:20,323 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-13 04:54:20,341 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/8001c6cf5bac43fe9002bf0083b143fb, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/211c51481f3f45ea839006e7ba5c8079, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/e0f74825ef7b44369ed4c96755464cc9, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/c18d7ff1f5ad4bd5852c1e27ae37e616, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/19b9c0cdf0a6496686bda0ef02bc5a9b, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/5c5be18953a940dea3738e53ae25fe93, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/4eddd0d95a9f4ffd9d4d6e4bdbdd499b, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/07e0119476df464cae2454920e05f0d2, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/e20be62c3cbc47b4b416ae1dc7bb0932, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/92549902fb9c4bdba93e009dd14dff80_SeqId_44_] to archive 2023-11-13 04:54:20,342 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:54:20,344 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/8001c6cf5bac43fe9002bf0083b143fb to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/8001c6cf5bac43fe9002bf0083b143fb 2023-11-13 04:54:20,345 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/211c51481f3f45ea839006e7ba5c8079 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/211c51481f3f45ea839006e7ba5c8079 2023-11-13 04:54:20,346 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/e0f74825ef7b44369ed4c96755464cc9 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/e0f74825ef7b44369ed4c96755464cc9 2023-11-13 04:54:20,348 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/c18d7ff1f5ad4bd5852c1e27ae37e616 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/c18d7ff1f5ad4bd5852c1e27ae37e616 2023-11-13 04:54:20,349 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/19b9c0cdf0a6496686bda0ef02bc5a9b to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/19b9c0cdf0a6496686bda0ef02bc5a9b 2023-11-13 04:54:20,350 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/5c5be18953a940dea3738e53ae25fe93 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/5c5be18953a940dea3738e53ae25fe93 2023-11-13 04:54:20,351 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/4eddd0d95a9f4ffd9d4d6e4bdbdd499b to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/4eddd0d95a9f4ffd9d4d6e4bdbdd499b 2023-11-13 04:54:20,353 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/07e0119476df464cae2454920e05f0d2 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/07e0119476df464cae2454920e05f0d2 2023-11-13 04:54:20,355 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/e20be62c3cbc47b4b416ae1dc7bb0932 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/e20be62c3cbc47b4b416ae1dc7bb0932 2023-11-13 04:54:20,356 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8f7e4651329a446c8a5bb4a31816d94d first=Optional[r00] last=Optional[r2] 2023-11-13 04:54:20,356 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/92549902fb9c4bdba93e009dd14dff80_SeqId_44_ to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/92549902fb9c4bdba93e009dd14dff80_SeqId_44_ 2023-11-13 04:54:20,356 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d., hostname=jenkins-hbase4.apache.org,41657,1699851201532, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8f7e4651329a446c8a5bb4a31816d94d}] 2023-11-13 04:54:20,359 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(763): Validating hfile at hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8f7e4651329a446c8a5bb4a31816d94d for inclusion in 636529c4d3fc4ed9b0aa1a1d0c8a802d/family1 2023-11-13 04:54:20,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-13 04:54:20,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(777): Region bounds: first= last= 2023-11-13 04:54:20,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HRegion(2446): Flush status journal for 636529c4d3fc4ed9b0aa1a1d0c8a802d: 2023-11-13 04:54:20,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8f7e4651329a446c8a5bb4a31816d94d to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithWeeklyPolicy__v1s3nddaap1junsj1lbdnpqifjqlkdjugnuakpehtnhpchsuiiejn09illv0nine/family1/8f7e4651329a446c8a5bb4a31816d94d 2023-11-13 04:54:20,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithWeeklyPolicy__v1s3nddaap1junsj1lbdnpqifjqlkdjugnuakpehtnhpchsuiiejn09illv0nine/family1/8f7e4651329a446c8a5bb4a31816d94d as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/3b0a489996524d249d20c805335ed1ef_SeqId_47_ 2023-11-13 04:54:20,365 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(849): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithWeeklyPolicy__v1s3nddaap1junsj1lbdnpqifjqlkdjugnuakpehtnhpchsuiiejn09illv0nine/family1/8f7e4651329a446c8a5bb4a31816d94d into 636529c4d3fc4ed9b0aa1a1d0c8a802d/family1 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/3b0a489996524d249d20c805335ed1ef_SeqId_47_ - updating store file list. 2023-11-13 04:54:20,370 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(882): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/3b0a489996524d249d20c805335ed1ef_SeqId_47_ into 636529c4d3fc4ed9b0aa1a1d0c8a802d/family1 2023-11-13 04:54:20,370 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(855): Successfully loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithWeeklyPolicy__v1s3nddaap1junsj1lbdnpqifjqlkdjugnuakpehtnhpchsuiiejn09illv0nine/family1/8f7e4651329a446c8a5bb4a31816d94d into 636529c4d3fc4ed9b0aa1a1d0c8a802d/family1 (new location: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/3b0a489996524d249d20c805335ed1ef_SeqId_47_) 2023-11-13 04:54:20,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithWeeklyPolicy__v1s3nddaap1junsj1lbdnpqifjqlkdjugnuakpehtnhpchsuiiejn09illv0nine/family1/8f7e4651329a446c8a5bb4a31816d94d 2023-11-13 04:54:20,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-13 04:54:20,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 345120 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-13 04:54:20,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(1912): 636529c4d3fc4ed9b0aa1a1d0c8a802d/family1 is initiating minor compaction (all files) 2023-11-13 04:54:20,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6f17efc4; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-13 04:54:20,372 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 636529c4d3fc4ed9b0aa1a1d0c8a802d/family1 in testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d. 2023-11-13 04:54:20,372 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/fd6c196c52574b19861a2692bb2b9d86, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/cbd95510fe6b4426acd293e80d668098, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/3b0a489996524d249d20c805335ed1ef_SeqId_47_] into tmpdir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/.tmp, totalSize=337.0 K 2023-11-13 04:54:20,373 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting fd6c196c52574b19861a2692bb2b9d86, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878824229 2023-11-13 04:54:20,373 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting cbd95510fe6b4426acd293e80d668098, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621224229 2023-11-13 04:54:20,373 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 3b0a489996524d249d20c805335ed1ef_SeqId_47_, keycount=1002, bloomtype=ROW, size=165.4 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878824229 2023-11-13 04:54:20,374 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-13 04:54:20,375 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:54:20,376 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130c7422809505644cdaf3ef4d385d9bc0b to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130c7422809505644cdaf3ef4d385d9bc0b 2023-11-13 04:54:20,378 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015120124ac7e3226c247b5a928bd471a7db9c5 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015120124ac7e3226c247b5a928bd471a7db9c5 2023-11-13 04:54:20,380 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205058c84e2e8b94d3493fcaff8d519d8b6 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205058c84e2e8b94d3493fcaff8d519d8b6 2023-11-13 04:54:20,380 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-11-13 04:54:20,380 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-13 04:54:20,380 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-13 04:54:20,380 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-13 04:54:20,380 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-13 04:54:20,381 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-13 04:54:20,383 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.4370 sec 2023-11-13 04:54:20,390 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] throttle.PressureAwareThroughputController(145): 636529c4d3fc4ed9b0aa1a1d0c8a802d#family1#compaction#49 average throughput is 22.09 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-13 04:54:20,482 INFO [Listener at localhost/34517] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=259 (was 249) - Thread LEAK? -, OpenFileDescriptor=648 (was 611) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=156 (was 184), ProcessCount=169 (was 169), AvailableMemoryMB=2538 (was 2543) 2023-11-13 04:54:20,494 INFO [Listener at localhost/34517] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=259, OpenFileDescriptor=648, MaxFileDescriptor=60000, SystemLoadAverage=156, ProcessCount=169, AvailableMemoryMB=2538 2023-11-13 04:54:20,496 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-13 04:54:20,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure2.ProcedureExecutor(1028): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:20,498 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-11-13 04:54:20,498 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-11-13 04:54:20,498 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-13 04:54:20,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-13 04:54:20,500 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32 2023-11-13 04:54:20,500 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32 empty. 2023-11-13 04:54:20,501 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32 2023-11-13 04:54:20,501 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-11-13 04:54:20,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-13 04:54:20,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-13 04:54:20,909 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-11-13 04:54:20,910 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7675): creating {ENCODED => ce3aa54af75e8a2d70418cb3df223e32, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp 2023-11-13 04:54:21,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-13 04:54:21,316 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-13 04:54:21,316 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1604): Closing ce3aa54af75e8a2d70418cb3df223e32, disabling compactions & flushes 2023-11-13 04:54:21,316 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. 2023-11-13 04:54:21,316 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. 2023-11-13 04:54:21,316 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. after waiting 0 ms 2023-11-13 04:54:21,316 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. 2023-11-13 04:54:21,316 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. 2023-11-13 04:54:21,316 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1558): Region close journal for ce3aa54af75e8a2d70418cb3df223e32: 2023-11-13 04:54:21,319 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-11-13 04:54:21,320 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699851261320"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699851261320"}]},"ts":"1699851261320"} 2023-11-13 04:54:21,321 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-13 04:54:21,322 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-13 04:54:21,322 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699851261322"}]},"ts":"1699851261322"} 2023-11-13 04:54:21,323 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-11-13 04:54:21,329 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=ce3aa54af75e8a2d70418cb3df223e32, ASSIGN}] 2023-11-13 04:54:21,331 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=ce3aa54af75e8a2d70418cb3df223e32, ASSIGN 2023-11-13 04:54:21,331 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=ce3aa54af75e8a2d70418cb3df223e32, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41657,1699851201532; forceNewPlan=false, retain=false 2023-11-13 04:54:21,482 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=ce3aa54af75e8a2d70418cb3df223e32, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:21,482 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699851261482"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699851261482"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699851261482"}]},"ts":"1699851261482"} 2023-11-13 04:54:21,484 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure ce3aa54af75e8a2d70418cb3df223e32, server=jenkins-hbase4.apache.org,41657,1699851201532}] 2023-11-13 04:54:21,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-13 04:54:21,608 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/.tmp/family1/3e08bbcdcc5d4f8e9a1a42c0c86ae1e7 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/3e08bbcdcc5d4f8e9a1a42c0c86ae1e7 2023-11-13 04:54:21,613 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 636529c4d3fc4ed9b0aa1a1d0c8a802d/family1 of 636529c4d3fc4ed9b0aa1a1d0c8a802d into 3e08bbcdcc5d4f8e9a1a42c0c86ae1e7(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-13 04:54:21,613 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 636529c4d3fc4ed9b0aa1a1d0c8a802d: 2023-11-13 04:54:21,613 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d., storeName=family1, fileCount=3, fileSize=337.0 K (165.1 K, 6.6 K, 165.4 K), priority=2, time=1699851260372; duration=1sec 2023-11-13 04:54:21,613 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-13 04:54:21,632 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/fd6c196c52574b19861a2692bb2b9d86, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/cbd95510fe6b4426acd293e80d668098, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/3b0a489996524d249d20c805335ed1ef_SeqId_47_] to archive 2023-11-13 04:54:21,633 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:54:21,635 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/fd6c196c52574b19861a2692bb2b9d86 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/fd6c196c52574b19861a2692bb2b9d86 2023-11-13 04:54:21,636 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/cbd95510fe6b4426acd293e80d668098 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/cbd95510fe6b4426acd293e80d668098 2023-11-13 04:54:21,636 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:21,637 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/3b0a489996524d249d20c805335ed1ef_SeqId_47_ to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/family1/3b0a489996524d249d20c805335ed1ef_SeqId_47_ 2023-11-13 04:54:21,638 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. 2023-11-13 04:54:21,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ce3aa54af75e8a2d70418cb3df223e32, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32.', STARTKEY => '', ENDKEY => ''} 2023-11-13 04:54:21,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly ce3aa54af75e8a2d70418cb3df223e32 2023-11-13 04:54:21,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-13 04:54:21,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ce3aa54af75e8a2d70418cb3df223e32 2023-11-13 04:54:21,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ce3aa54af75e8a2d70418cb3df223e32 2023-11-13 04:54:21,640 INFO [StoreOpener-ce3aa54af75e8a2d70418cb3df223e32-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ce3aa54af75e8a2d70418cb3df223e32 2023-11-13 04:54:21,641 DEBUG [StoreOpener-ce3aa54af75e8a2d70418cb3df223e32-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1 2023-11-13 04:54:21,641 DEBUG [StoreOpener-ce3aa54af75e8a2d70418cb3df223e32-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1 2023-11-13 04:54:21,641 INFO [StoreOpener-ce3aa54af75e8a2d70418cb3df223e32-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ce3aa54af75e8a2d70418cb3df223e32 columnFamilyName family1 2023-11-13 04:54:21,642 INFO [StoreOpener-ce3aa54af75e8a2d70418cb3df223e32-1] regionserver.HStore(310): Store=ce3aa54af75e8a2d70418cb3df223e32/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-13 04:54:21,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32 2023-11-13 04:54:21,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32 2023-11-13 04:54:21,646 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ce3aa54af75e8a2d70418cb3df223e32 2023-11-13 04:54:21,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-13 04:54:21,648 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ce3aa54af75e8a2d70418cb3df223e32; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62950389, jitterRate=-0.06196610629558563}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-13 04:54:21,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ce3aa54af75e8a2d70418cb3df223e32: 2023-11-13 04:54:21,649 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32., pid=41, masterSystemTime=1699851261636 2023-11-13 04:54:21,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. 2023-11-13 04:54:21,651 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. 2023-11-13 04:54:21,651 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=ce3aa54af75e8a2d70418cb3df223e32, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:21,651 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699851261651"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699851261651"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699851261651"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699851261651"}]},"ts":"1699851261651"} 2023-11-13 04:54:21,653 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=41, resume processing ppid=40 2023-11-13 04:54:21,654 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure ce3aa54af75e8a2d70418cb3df223e32, server=jenkins-hbase4.apache.org,41657,1699851201532 in 168 msec 2023-11-13 04:54:21,655 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=39 2023-11-13 04:54:21,655 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=ce3aa54af75e8a2d70418cb3df223e32, ASSIGN in 325 msec 2023-11-13 04:54:21,656 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-13 04:54:21,656 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699851261656"}]},"ts":"1699851261656"} 2023-11-13 04:54:21,657 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-11-13 04:54:21,659 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-11-13 04:54:21,660 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1630 sec 2023-11-13 04:54:22,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-13 04:54:22,603 INFO [Listener at localhost/34517] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-11-13 04:54:22,626 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:54:22,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:22,627 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-13 04:54:22,627 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:22,628 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-13 04:54:22,628 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-13 04:54:22,628 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:22,628 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:22,629 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:22,630 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:22,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:22,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:22,630 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:22,630 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:54:22,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:22,630 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:22,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:54:22,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:22,631 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:22,631 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:22,631 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-13 04:54:22,631 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:22,631 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-13 04:54:22,631 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:54:22,631 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:54:22,631 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. 2023-11-13 04:54:22,631 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. started... 2023-11-13 04:54:22,632 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ce3aa54af75e8a2d70418cb3df223e32 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-13 04:54:22,836 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-13 04:54:23,051 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511306a6f55e669d242ee8576481f1578ea5a to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511306a6f55e669d242ee8576481f1578ea5a 2023-11-13 04:54:23,455 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/.tmp/family1/a5ef79dfbbcc4a809036016ecccce36a 2023-11-13 04:54:23,460 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/.tmp/family1/a5ef79dfbbcc4a809036016ecccce36a as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/a5ef79dfbbcc4a809036016ecccce36a 2023-11-13 04:54:23,463 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/a5ef79dfbbcc4a809036016ecccce36a, entries=1000, sequenceid=5, filesize=191.4 K 2023-11-13 04:54:23,464 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for ce3aa54af75e8a2d70418cb3df223e32 in 832ms, sequenceid=5, compaction requested=false 2023-11-13 04:54:23,465 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ce3aa54af75e8a2d70418cb3df223e32: 2023-11-13 04:54:23,465 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. 2023-11-13 04:54:23,465 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:54:23,465 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:54:23,465 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:23,465 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-13 04:54:23,465 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-13 04:54:23,467 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:23,467 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:23,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:23,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:23,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:23,467 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:23,467 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:54:23,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:23,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:23,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:23,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:23,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:23,469 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-13 04:54:23,469 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6f0a8125[Count = 0] remaining members to acquire global barrier 2023-11-13 04:54:23,469 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-13 04:54:23,469 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:23,471 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:23,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:23,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:23,471 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-13 04:54:23,471 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-13 04:54:23,471 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:54:23,471 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:23,471 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:54:23,473 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-13 04:54:23,473 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:23,473 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:23,473 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-13 04:54:23,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:23,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:23,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:23,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:23,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:23,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:23,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:23,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:23,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:23,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:23,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:54:23,475 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-13 04:54:23,475 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-13 04:54:23,475 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:54:23,475 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:54:23,475 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:23,475 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:54:23,477 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:23,477 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:23,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:23,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:23,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:23,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:23,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:23,477 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:23,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:23,478 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:23,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:23,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:23,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:23,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:23,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:23,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:23,479 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:23,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:23,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:23,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:23,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:23,481 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:23,481 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:23,481 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:23,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:23,481 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:23,481 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:23,481 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-13 04:54:23,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:23,481 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-13 04:54:23,481 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:54:23,481 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:23,482 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:23,482 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:23,482 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:23,482 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:23,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:23,482 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-13 04:54:23,482 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:54:23,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:23,582 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:54:23,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:54:23,587 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:54:23,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-13 04:54:23,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:23,588 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-13 04:54:23,588 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:23,589 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-13 04:54:23,589 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-13 04:54:23,589 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:23,589 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:23,591 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:23,591 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:23,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:23,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:23,592 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:23,592 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:54:23,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:23,592 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:23,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:54:23,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:23,592 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:23,592 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-13 04:54:23,593 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:23,593 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-13 04:54:23,593 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:23,593 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-13 04:54:23,593 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:54:23,593 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:54:23,593 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. 2023-11-13 04:54:23,593 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. started... 2023-11-13 04:54:23,593 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ce3aa54af75e8a2d70418cb3df223e32 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-13 04:54:24,005 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128a8f006cf459d44c8a16b07cf36022916 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128a8f006cf459d44c8a16b07cf36022916 2023-11-13 04:54:24,410 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/.tmp/family1/848f42ca7f84405d8caa9069d14afbf7 2023-11-13 04:54:24,416 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/.tmp/family1/848f42ca7f84405d8caa9069d14afbf7 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/848f42ca7f84405d8caa9069d14afbf7 2023-11-13 04:54:24,420 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/848f42ca7f84405d8caa9069d14afbf7, entries=1, sequenceid=9, filesize=5.0 K 2023-11-13 04:54:24,420 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for ce3aa54af75e8a2d70418cb3df223e32 in 827ms, sequenceid=9, compaction requested=false 2023-11-13 04:54:24,420 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ce3aa54af75e8a2d70418cb3df223e32: 2023-11-13 04:54:24,421 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. 2023-11-13 04:54:24,421 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:54:24,421 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:54:24,421 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:24,421 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-13 04:54:24,421 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-13 04:54:24,422 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:24,422 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:24,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:24,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:24,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:24,423 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:24,423 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:54:24,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:24,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:24,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:24,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:24,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:24,424 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-13 04:54:24,424 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a5f1215[Count = 0] remaining members to acquire global barrier 2023-11-13 04:54:24,424 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-13 04:54:24,424 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:24,426 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:24,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:24,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:24,426 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-13 04:54:24,426 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-13 04:54:24,426 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:54:24,426 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:24,426 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:54:24,428 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:24,428 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-13 04:54:24,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:24,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:24,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:24,428 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:24,428 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-13 04:54:24,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:24,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:24,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:24,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:24,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:24,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:24,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:24,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:54:24,430 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-13 04:54:24,430 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-13 04:54:24,430 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:54:24,430 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:54:24,431 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:24,431 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:54:24,432 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:24,432 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:24,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:24,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:24,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:24,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:24,432 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:24,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:24,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:24,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:24,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:24,433 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:24,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:24,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:24,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:24,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:24,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:24,434 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:24,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:24,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:24,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:24,440 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:24,440 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:24,440 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:24,440 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:24,440 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:24,440 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-13 04:54:24,440 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:54:24,440 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:24,440 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:24,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:24,440 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:24,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:24,440 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:24,440 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-13 04:54:24,440 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:24,440 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:54:24,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:24,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:24,540 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:54:24,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:54:24,545 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:54:24,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-13 04:54:24,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:24,547 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-13 04:54:24,547 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:24,547 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-13 04:54:24,547 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-13 04:54:24,547 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:24,547 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:24,549 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:24,549 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:24,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:24,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:24,549 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:24,549 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:54:24,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:24,549 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:24,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:54:24,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:24,550 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:24,550 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-13 04:54:24,550 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:24,550 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-13 04:54:24,550 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:24,550 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-13 04:54:24,550 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:54:24,550 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:54:24,550 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. 2023-11-13 04:54:24,550 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. started... 2023-11-13 04:54:24,550 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ce3aa54af75e8a2d70418cb3df223e32 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:54:24,963 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512019ad6a1e2abea4ae9a704c1278ebfa5ab to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512019ad6a1e2abea4ae9a704c1278ebfa5ab 2023-11-13 04:54:25,369 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/.tmp/family1/8569b269c1334c84a54e2820cb6c2024 2023-11-13 04:54:25,374 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/.tmp/family1/8569b269c1334c84a54e2820cb6c2024 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/8569b269c1334c84a54e2820cb6c2024 2023-11-13 04:54:25,378 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/8569b269c1334c84a54e2820cb6c2024, entries=1, sequenceid=13, filesize=5.0 K 2023-11-13 04:54:25,379 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ce3aa54af75e8a2d70418cb3df223e32 in 829ms, sequenceid=13, compaction requested=true 2023-11-13 04:54:25,379 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ce3aa54af75e8a2d70418cb3df223e32: 2023-11-13 04:54:25,379 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. 2023-11-13 04:54:25,379 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:54:25,379 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:54:25,379 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:25,379 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-13 04:54:25,379 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-13 04:54:25,381 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:25,381 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:25,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:25,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:25,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:25,382 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:25,382 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:54:25,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:25,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:25,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:25,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:25,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:25,383 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-13 04:54:25,383 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4a9cc765[Count = 0] remaining members to acquire global barrier 2023-11-13 04:54:25,383 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-13 04:54:25,384 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:25,385 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:25,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:25,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:25,385 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-13 04:54:25,385 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-13 04:54:25,385 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:54:25,385 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:25,385 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:54:25,386 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:25,386 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-13 04:54:25,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:25,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:25,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:25,387 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:25,387 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-13 04:54:25,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:25,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:25,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:25,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:25,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:25,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:25,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:25,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:54:25,389 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-13 04:54:25,389 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-13 04:54:25,389 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:54:25,389 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:54:25,389 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:25,389 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:54:25,391 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:25,391 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:25,391 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:25,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:25,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:25,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:25,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:25,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:25,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:25,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:25,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:25,391 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:25,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:25,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:25,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:25,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:25,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:25,393 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:25,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:25,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:25,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:25,396 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:25,396 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:25,396 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:25,396 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:25,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:25,396 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-13 04:54:25,396 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:54:25,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:25,396 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:25,396 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:25,396 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:25,396 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:25,397 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:25,397 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-13 04:54:25,397 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:54:25,397 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:25,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:25,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:25,497 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:54:25,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:54:25,501 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:54:25,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-13 04:54:25,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:25,503 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-13 04:54:25,503 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:25,503 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-13 04:54:25,503 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-13 04:54:25,503 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:25,503 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:25,505 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:25,505 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:25,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:25,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:25,505 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:25,505 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:54:25,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:25,506 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:25,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:54:25,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:25,506 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:25,506 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-13 04:54:25,506 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:25,506 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-13 04:54:25,506 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:25,506 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-13 04:54:25,507 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:54:25,507 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:54:25,507 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. 2023-11-13 04:54:25,507 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. started... 2023-11-13 04:54:25,507 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ce3aa54af75e8a2d70418cb3df223e32 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:54:25,918 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205ffa7e425b10f4bf7a8416f5261b6f21a to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205ffa7e425b10f4bf7a8416f5261b6f21a 2023-11-13 04:54:26,323 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/.tmp/family1/f86182dd16874789af7bd5e2534e152e 2023-11-13 04:54:26,328 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/.tmp/family1/f86182dd16874789af7bd5e2534e152e as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/f86182dd16874789af7bd5e2534e152e 2023-11-13 04:54:26,332 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/f86182dd16874789af7bd5e2534e152e, entries=1, sequenceid=17, filesize=5.0 K 2023-11-13 04:54:26,333 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ce3aa54af75e8a2d70418cb3df223e32 in 826ms, sequenceid=17, compaction requested=true 2023-11-13 04:54:26,333 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ce3aa54af75e8a2d70418cb3df223e32: 2023-11-13 04:54:26,333 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. 2023-11-13 04:54:26,333 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:54:26,333 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:54:26,333 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:26,333 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-13 04:54:26,333 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-13 04:54:26,335 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:26,335 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:26,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:26,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:26,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:26,335 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:26,335 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:54:26,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:26,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:26,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:26,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:26,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:26,337 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-13 04:54:26,337 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5acb222f[Count = 0] remaining members to acquire global barrier 2023-11-13 04:54:26,337 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-13 04:54:26,337 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:26,338 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:26,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:26,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:26,338 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-13 04:54:26,338 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-13 04:54:26,338 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:54:26,338 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:26,338 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:54:26,343 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-13 04:54:26,343 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:26,343 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:26,343 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-13 04:54:26,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:26,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:26,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:26,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:26,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:26,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:26,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:26,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:26,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:26,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:26,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:54:26,346 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-13 04:54:26,346 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-13 04:54:26,346 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:54:26,346 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:54:26,346 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:26,346 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:54:26,347 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:26,348 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:26,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:26,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:26,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:26,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:26,348 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:26,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:26,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:26,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:26,348 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:26,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:26,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:26,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:26,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:26,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:26,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:26,350 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:26,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:26,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:26,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:26,352 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:26,352 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:26,352 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:26,352 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:26,352 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:26,352 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-13 04:54:26,352 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:54:26,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:26,352 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:26,352 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:26,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:26,352 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:26,352 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-13 04:54:26,352 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:26,352 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:54:26,353 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:26,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:26,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:26,453 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:54:26,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:54:26,457 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:54:26,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-13 04:54:26,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:26,459 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-13 04:54:26,459 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:26,459 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-13 04:54:26,459 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-13 04:54:26,459 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:26,459 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:26,465 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:26,465 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:26,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:26,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:26,465 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:26,465 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:54:26,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:26,465 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:26,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:54:26,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:26,466 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:26,466 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-13 04:54:26,466 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:26,466 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-13 04:54:26,466 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:26,466 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-13 04:54:26,466 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:54:26,466 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:54:26,466 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. 2023-11-13 04:54:26,466 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. started... 2023-11-13 04:54:26,466 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ce3aa54af75e8a2d70418cb3df223e32 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:54:26,878 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512281eebd49c85ae4b2ab7e58ec3ae7925ed to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512281eebd49c85ae4b2ab7e58ec3ae7925ed 2023-11-13 04:54:27,169 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-13 04:54:27,284 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/.tmp/family1/8b884687547947a9bd9fa226b744d2cd 2023-11-13 04:54:27,288 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/.tmp/family1/8b884687547947a9bd9fa226b744d2cd as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/8b884687547947a9bd9fa226b744d2cd 2023-11-13 04:54:27,292 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/8b884687547947a9bd9fa226b744d2cd, entries=1, sequenceid=21, filesize=5.0 K 2023-11-13 04:54:27,293 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ce3aa54af75e8a2d70418cb3df223e32 in 827ms, sequenceid=21, compaction requested=true 2023-11-13 04:54:27,293 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ce3aa54af75e8a2d70418cb3df223e32: 2023-11-13 04:54:27,293 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. 2023-11-13 04:54:27,293 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:54:27,293 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:54:27,293 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:27,293 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-13 04:54:27,293 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-13 04:54:27,295 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:27,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:27,295 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:27,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:27,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:27,296 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:27,296 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:54:27,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:27,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:27,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:27,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:27,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:27,297 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-13 04:54:27,297 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@617393fa[Count = 0] remaining members to acquire global barrier 2023-11-13 04:54:27,297 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-13 04:54:27,297 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:27,299 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:27,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:27,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:27,300 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-13 04:54:27,300 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-13 04:54:27,300 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:54:27,300 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:27,300 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:54:27,301 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-13 04:54:27,301 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:27,302 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:27,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:27,302 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-13 04:54:27,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:27,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:27,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:27,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:27,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:27,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:27,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:27,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:27,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:27,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:54:27,304 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-13 04:54:27,304 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-13 04:54:27,304 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:54:27,304 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:54:27,304 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:27,304 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:54:27,306 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:27,306 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:27,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:27,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:27,306 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:27,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:27,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:27,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:27,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:27,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:27,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:27,306 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:27,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:27,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:27,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:27,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:27,308 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:27,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:27,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:27,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:27,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:27,310 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:27,310 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:27,310 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:27,310 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:27,310 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:27,310 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:27,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:27,310 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:27,310 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-13 04:54:27,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:27,310 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-13 04:54:27,310 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:54:27,310 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:27,310 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:27,310 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:27,310 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-13 04:54:27,311 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:54:27,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:27,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:27,411 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:54:27,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:54:27,415 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:54:27,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-13 04:54:27,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:27,417 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-13 04:54:27,417 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:27,417 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-13 04:54:27,417 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-13 04:54:27,417 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:27,417 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:27,419 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:27,419 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:27,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:27,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:27,420 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:27,420 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:54:27,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:27,420 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:27,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:54:27,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:27,421 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:27,421 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-13 04:54:27,421 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:27,421 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-13 04:54:27,421 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:27,421 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-13 04:54:27,421 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:54:27,421 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:54:27,421 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. 2023-11-13 04:54:27,421 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. started... 2023-11-13 04:54:27,422 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ce3aa54af75e8a2d70418cb3df223e32 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:54:27,834 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231cd71afa29d26496e8de73afd2c513269 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231cd71afa29d26496e8de73afd2c513269 2023-11-13 04:54:28,240 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/.tmp/family1/627cfda5c13e4b789ba8aa5aafde7dcd 2023-11-13 04:54:28,244 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/.tmp/family1/627cfda5c13e4b789ba8aa5aafde7dcd as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/627cfda5c13e4b789ba8aa5aafde7dcd 2023-11-13 04:54:28,248 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/627cfda5c13e4b789ba8aa5aafde7dcd, entries=1, sequenceid=25, filesize=5.0 K 2023-11-13 04:54:28,249 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ce3aa54af75e8a2d70418cb3df223e32 in 828ms, sequenceid=25, compaction requested=true 2023-11-13 04:54:28,249 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ce3aa54af75e8a2d70418cb3df223e32: 2023-11-13 04:54:28,249 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. 2023-11-13 04:54:28,249 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:54:28,249 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:54:28,249 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:28,249 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-13 04:54:28,249 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-13 04:54:28,251 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:28,251 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:28,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:28,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:28,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:28,251 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:28,251 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:54:28,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:28,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:28,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:28,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:28,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:28,253 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-13 04:54:28,253 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@33eeea7b[Count = 0] remaining members to acquire global barrier 2023-11-13 04:54:28,253 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-13 04:54:28,253 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:28,254 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:28,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:28,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:28,254 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-13 04:54:28,254 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-13 04:54:28,254 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:54:28,254 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:28,254 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:54:28,255 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:28,255 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-13 04:54:28,256 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:28,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:28,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:28,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:28,256 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-13 04:54:28,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:28,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:28,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:28,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:28,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:28,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:28,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:28,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:54:28,258 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-13 04:54:28,258 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-13 04:54:28,258 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:54:28,258 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:54:28,258 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:28,258 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:54:28,260 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:28,260 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:28,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:28,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:28,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:28,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:28,260 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:28,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:28,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:28,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:28,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:28,261 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:28,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:28,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:28,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:28,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:28,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:28,262 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:28,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:28,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:28,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:28,264 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:28,265 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:28,265 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:28,265 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:28,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:28,265 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-13 04:54:28,265 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:54:28,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:28,265 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:28,265 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:28,265 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:28,265 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:28,265 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:28,265 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-13 04:54:28,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:28,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:28,265 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:54:28,265 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:28,365 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:54:28,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:54:28,369 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:54:28,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-13 04:54:28,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:28,371 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-13 04:54:28,371 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:28,371 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-13 04:54:28,371 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-13 04:54:28,371 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:28,371 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:28,373 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:28,373 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:28,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:28,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:28,374 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:28,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:28,374 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:54:28,374 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:28,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:54:28,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:28,374 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:28,374 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-13 04:54:28,374 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:28,375 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-13 04:54:28,375 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:28,375 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-13 04:54:28,375 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:54:28,375 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:54:28,375 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. 2023-11-13 04:54:28,375 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. started... 2023-11-13 04:54:28,375 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ce3aa54af75e8a2d70418cb3df223e32 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:54:28,788 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101de86f65313cc48d3a51cf2e40983d633 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101de86f65313cc48d3a51cf2e40983d633 2023-11-13 04:54:29,194 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/.tmp/family1/e69ea8880373490388185806515ecf72 2023-11-13 04:54:29,199 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/.tmp/family1/e69ea8880373490388185806515ecf72 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/e69ea8880373490388185806515ecf72 2023-11-13 04:54:29,203 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/e69ea8880373490388185806515ecf72, entries=1, sequenceid=29, filesize=5.0 K 2023-11-13 04:54:29,203 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ce3aa54af75e8a2d70418cb3df223e32 in 828ms, sequenceid=29, compaction requested=true 2023-11-13 04:54:29,204 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ce3aa54af75e8a2d70418cb3df223e32: 2023-11-13 04:54:29,204 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. 2023-11-13 04:54:29,204 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:54:29,204 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:54:29,204 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:29,204 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-13 04:54:29,204 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-13 04:54:29,205 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:29,205 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:29,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:29,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:29,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:29,206 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:29,206 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:54:29,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:29,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:29,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:29,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:29,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:29,207 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-13 04:54:29,207 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1fe5a48c[Count = 0] remaining members to acquire global barrier 2023-11-13 04:54:29,207 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-13 04:54:29,208 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:29,210 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:29,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:29,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:29,210 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-13 04:54:29,210 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:29,210 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:54:29,210 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-13 04:54:29,210 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:54:29,216 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-13 04:54:29,216 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:29,216 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:29,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:29,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:29,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:29,216 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-13 04:54:29,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:29,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:29,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:29,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:29,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:29,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:29,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:29,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:54:29,219 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-13 04:54:29,219 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-13 04:54:29,219 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:54:29,219 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:54:29,219 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:29,219 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:54:29,220 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:29,220 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:29,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:29,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:29,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:29,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:29,220 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:29,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:29,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:29,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:29,221 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:29,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:29,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:29,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:29,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:29,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:29,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:29,222 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:29,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:29,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:29,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:29,225 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:29,225 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:29,225 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:29,225 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:29,225 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:29,225 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:29,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:29,225 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-13 04:54:29,225 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:54:29,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:29,225 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:29,225 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:29,225 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:29,225 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:29,225 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-13 04:54:29,226 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:54:29,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:29,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:29,326 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:54:29,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:54:29,330 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:54:29,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-13 04:54:29,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:29,332 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-13 04:54:29,332 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:29,332 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-13 04:54:29,332 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-13 04:54:29,332 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:29,332 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:29,334 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:29,334 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:29,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:29,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:29,334 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:29,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:29,334 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:54:29,334 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:29,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:54:29,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:29,335 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:29,335 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-13 04:54:29,335 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:29,335 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-13 04:54:29,335 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:29,335 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-13 04:54:29,335 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:54:29,335 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:54:29,335 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. 2023-11-13 04:54:29,335 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. started... 2023-11-13 04:54:29,336 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ce3aa54af75e8a2d70418cb3df223e32 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:54:29,749 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103f866f5efcd7941b399b0a0ac9de9d463 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103f866f5efcd7941b399b0a0ac9de9d463 2023-11-13 04:54:30,154 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/.tmp/family1/20e5b63b21774c5faf8c1cd4426ed0e2 2023-11-13 04:54:30,159 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/.tmp/family1/20e5b63b21774c5faf8c1cd4426ed0e2 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/20e5b63b21774c5faf8c1cd4426ed0e2 2023-11-13 04:54:30,162 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/20e5b63b21774c5faf8c1cd4426ed0e2, entries=1, sequenceid=33, filesize=5.0 K 2023-11-13 04:54:30,163 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ce3aa54af75e8a2d70418cb3df223e32 in 827ms, sequenceid=33, compaction requested=true 2023-11-13 04:54:30,163 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ce3aa54af75e8a2d70418cb3df223e32: 2023-11-13 04:54:30,163 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. 2023-11-13 04:54:30,163 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:54:30,163 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:54:30,163 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:30,163 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-13 04:54:30,164 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-13 04:54:30,171 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:30,171 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:30,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:30,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:30,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:30,171 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:30,171 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:54:30,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:30,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:30,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:30,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:30,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:30,173 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-13 04:54:30,173 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1cbc3705[Count = 0] remaining members to acquire global barrier 2023-11-13 04:54:30,173 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-13 04:54:30,173 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:30,174 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:30,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:30,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:30,174 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-13 04:54:30,174 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-13 04:54:30,174 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:30,174 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:54:30,174 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:54:30,176 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:30,176 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-13 04:54:30,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:30,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:30,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:30,176 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:30,176 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-13 04:54:30,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:30,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:30,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:30,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:30,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:30,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:30,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:30,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:54:30,178 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-13 04:54:30,178 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-13 04:54:30,178 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:54:30,178 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:54:30,178 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:30,178 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:54:30,180 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:30,180 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:30,180 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:30,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:30,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:30,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:30,180 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:30,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:30,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:30,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:30,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:30,181 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:30,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:30,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:30,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:30,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:30,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:30,182 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:30,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:30,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:30,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:30,186 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:30,186 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:30,186 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:30,186 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:30,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:30,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:30,186 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:30,186 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-13 04:54:30,186 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:54:30,186 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:30,186 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:30,186 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:30,186 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:30,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:30,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:30,186 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-13 04:54:30,186 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:30,187 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:54:30,287 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:54:30,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:54:30,291 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:54:30,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-13 04:54:30,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:30,293 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-13 04:54:30,293 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:30,293 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-13 04:54:30,293 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-13 04:54:30,294 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:30,294 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:30,295 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:30,295 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:30,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:30,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:30,295 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:30,295 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:54:30,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:30,296 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:30,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:54:30,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:30,296 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:30,297 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-13 04:54:30,297 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:30,297 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-13 04:54:30,297 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:30,297 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-13 04:54:30,297 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:54:30,297 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:54:30,297 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. 2023-11-13 04:54:30,297 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. started... 2023-11-13 04:54:30,297 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ce3aa54af75e8a2d70418cb3df223e32 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:54:30,710 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090730126ece918044688b3aa2876a0a92bd to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015090730126ece918044688b3aa2876a0a92bd 2023-11-13 04:54:31,115 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/.tmp/family1/059d3c69dffb4c38b7c75c9037d38733 2023-11-13 04:54:31,120 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/.tmp/family1/059d3c69dffb4c38b7c75c9037d38733 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/059d3c69dffb4c38b7c75c9037d38733 2023-11-13 04:54:31,124 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/059d3c69dffb4c38b7c75c9037d38733, entries=1, sequenceid=37, filesize=5.0 K 2023-11-13 04:54:31,125 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ce3aa54af75e8a2d70418cb3df223e32 in 828ms, sequenceid=37, compaction requested=true 2023-11-13 04:54:31,125 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ce3aa54af75e8a2d70418cb3df223e32: 2023-11-13 04:54:31,125 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. 2023-11-13 04:54:31,125 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:54:31,125 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:54:31,125 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:31,125 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-13 04:54:31,125 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-13 04:54:31,127 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:31,127 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:31,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:31,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:31,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:31,127 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:31,127 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:54:31,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:31,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:31,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:31,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:31,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:31,129 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-13 04:54:31,129 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@61ad9b2b[Count = 0] remaining members to acquire global barrier 2023-11-13 04:54:31,129 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-13 04:54:31,129 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:31,130 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:31,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:31,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:31,130 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-13 04:54:31,130 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:31,131 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:54:31,130 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-13 04:54:31,131 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:54:31,135 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-13 04:54:31,135 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:31,135 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:31,135 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-13 04:54:31,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:31,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:31,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:31,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:31,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:31,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:31,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:31,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:31,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:31,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:31,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:54:31,137 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-13 04:54:31,137 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-13 04:54:31,137 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:54:31,137 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:54:31,137 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:31,137 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:54:31,139 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:31,139 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:31,139 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:31,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:31,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:31,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:31,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:31,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:31,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:31,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:31,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:31,140 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:31,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:31,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:31,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:31,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:31,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:31,141 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:31,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:31,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:31,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:31,146 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:31,146 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:31,146 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:31,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:31,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:31,146 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:31,146 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-13 04:54:31,146 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:54:31,146 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:31,146 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:31,146 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:31,146 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:31,146 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:31,146 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:31,146 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-13 04:54:31,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:31,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:31,146 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:54:31,247 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:54:31,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:54:31,251 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:54:31,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-13 04:54:31,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:31,253 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-13 04:54:31,253 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:31,253 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-13 04:54:31,253 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-13 04:54:31,253 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:31,253 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:31,256 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:31,256 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:31,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:31,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:31,256 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:31,256 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:54:31,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:31,256 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:31,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:54:31,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:31,257 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:31,257 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-13 04:54:31,257 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:31,257 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-13 04:54:31,257 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:31,257 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-13 04:54:31,257 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:54:31,257 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:54:31,257 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. 2023-11-13 04:54:31,258 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. started... 2023-11-13 04:54:31,258 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ce3aa54af75e8a2d70418cb3df223e32 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:54:31,669 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120e54f1aceb1dc4cbea4cf6f2fb1647460 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120e54f1aceb1dc4cbea4cf6f2fb1647460 2023-11-13 04:54:32,075 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/.tmp/family1/af27a6a5a02e4596bf8766a03254675d 2023-11-13 04:54:32,079 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/.tmp/family1/af27a6a5a02e4596bf8766a03254675d as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/af27a6a5a02e4596bf8766a03254675d 2023-11-13 04:54:32,083 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/af27a6a5a02e4596bf8766a03254675d, entries=1, sequenceid=41, filesize=5.0 K 2023-11-13 04:54:32,084 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ce3aa54af75e8a2d70418cb3df223e32 in 826ms, sequenceid=41, compaction requested=true 2023-11-13 04:54:32,084 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ce3aa54af75e8a2d70418cb3df223e32: 2023-11-13 04:54:32,084 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. 2023-11-13 04:54:32,084 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:54:32,084 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:54:32,084 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:32,084 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-13 04:54:32,084 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-13 04:54:32,086 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:32,086 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:32,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:32,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:32,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:32,086 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:32,086 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:54:32,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:32,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:32,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:32,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:32,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:32,087 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-13 04:54:32,087 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@25540857[Count = 0] remaining members to acquire global barrier 2023-11-13 04:54:32,087 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-13 04:54:32,088 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:32,090 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:32,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:32,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:32,090 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-13 04:54:32,090 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-13 04:54:32,090 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:54:32,090 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:32,090 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:54:32,091 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-13 04:54:32,091 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:32,091 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:32,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:32,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:32,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:32,091 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-13 04:54:32,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:32,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:32,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:32,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:32,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:32,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:32,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:32,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:54:32,094 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-13 04:54:32,094 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-13 04:54:32,094 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:54:32,094 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:54:32,094 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:32,094 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:54:32,096 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:32,096 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:32,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:32,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:32,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:32,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:32,096 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:32,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:32,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:32,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:32,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:32,097 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:32,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:32,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:32,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:32,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:32,098 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:32,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:32,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:32,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:32,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:32,101 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:32,101 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:32,101 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:32,101 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:32,101 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-13 04:54:32,101 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:54:32,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:32,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:32,101 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-13 04:54:32,101 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:32,101 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:32,101 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:32,101 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:32,101 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-13 04:54:32,101 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:32,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:32,101 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:32,101 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:54:32,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:32,202 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:54:32,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:54:32,203 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33831] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:32,205 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-13 04:54:32,205 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-13 04:54:32,206 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699851872206 2023-11-13 04:54:32,206 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-13 04:54:32,209 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-13 04:54:32,210 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-13 04:54:32,210 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-13 04:54:32,211 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] zookeeper.ReadOnlyZKClient(139): Connect 0x3048c9dd to 127.0.0.1:51072 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-13 04:54:32,219 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1fe8910, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-13 04:54:32,220 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-13 04:54:33,054 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601031340424fef5449d2839b18a9c484534d to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601031340424fef5449d2839b18a9c484534d 2023-11-13 04:54:33,055 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-13 04:54:33,067 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-13 04:54:33,068 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35828, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-13 04:54:33,074 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-13 04:54:33,075 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47950, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-13 04:54:33,083 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/1870ff2584e44e43a1ce8ef2a1a57009 first=Optional[r3] last=Optional[r6] 2023-11-13 04:54:33,084 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32., hostname=jenkins-hbase4.apache.org,41657,1699851201532, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/1870ff2584e44e43a1ce8ef2a1a57009}] 2023-11-13 04:54:33,088 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(763): Validating hfile at hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/1870ff2584e44e43a1ce8ef2a1a57009 for inclusion in ce3aa54af75e8a2d70418cb3df223e32/family1 2023-11-13 04:54:33,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-13 04:54:33,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(777): Region bounds: first= last= 2023-11-13 04:54:33,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HRegion(2446): Flush status journal for ce3aa54af75e8a2d70418cb3df223e32: 2023-11-13 04:54:33,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/1870ff2584e44e43a1ce8ef2a1a57009 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__9ogoksec1gt066srp8hpc7gnqp95pra67m6idol7mnd50ta03ovd27ma1dsc4d1j/family1/1870ff2584e44e43a1ce8ef2a1a57009 2023-11-13 04:54:33,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__9ogoksec1gt066srp8hpc7gnqp95pra67m6idol7mnd50ta03ovd27ma1dsc4d1j/family1/1870ff2584e44e43a1ce8ef2a1a57009 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/5ea2d00cb7d5458ba7af1b27a7e42dda_SeqId_44_ 2023-11-13 04:54:33,094 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(849): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__9ogoksec1gt066srp8hpc7gnqp95pra67m6idol7mnd50ta03ovd27ma1dsc4d1j/family1/1870ff2584e44e43a1ce8ef2a1a57009 into ce3aa54af75e8a2d70418cb3df223e32/family1 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/5ea2d00cb7d5458ba7af1b27a7e42dda_SeqId_44_ - updating store file list. 2023-11-13 04:54:33,097 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(882): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/5ea2d00cb7d5458ba7af1b27a7e42dda_SeqId_44_ into ce3aa54af75e8a2d70418cb3df223e32/family1 2023-11-13 04:54:33,097 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(855): Successfully loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__9ogoksec1gt066srp8hpc7gnqp95pra67m6idol7mnd50ta03ovd27ma1dsc4d1j/family1/1870ff2584e44e43a1ce8ef2a1a57009 into ce3aa54af75e8a2d70418cb3df223e32/family1 (new location: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/5ea2d00cb7d5458ba7af1b27a7e42dda_SeqId_44_) 2023-11-13 04:54:33,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__9ogoksec1gt066srp8hpc7gnqp95pra67m6idol7mnd50ta03ovd27ma1dsc4d1j/family1/1870ff2584e44e43a1ce8ef2a1a57009 2023-11-13 04:54:33,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-13 04:54:33,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-13 04:54:33,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(1912): ce3aa54af75e8a2d70418cb3df223e32/family1 is initiating minor compaction 2023-11-13 04:54:33,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3f8f5ce2; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-13 04:54:33,101 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of ce3aa54af75e8a2d70418cb3df223e32/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. 2023-11-13 04:54:33,101 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/848f42ca7f84405d8caa9069d14afbf7, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/8569b269c1334c84a54e2820cb6c2024, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/f86182dd16874789af7bd5e2534e152e, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/8b884687547947a9bd9fa226b744d2cd, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/627cfda5c13e4b789ba8aa5aafde7dcd, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/e69ea8880373490388185806515ecf72, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/20e5b63b21774c5faf8c1cd4426ed0e2, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/059d3c69dffb4c38b7c75c9037d38733, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/af27a6a5a02e4596bf8766a03254675d, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/5ea2d00cb7d5458ba7af1b27a7e42dda_SeqId_44_] into tmpdir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/.tmp, totalSize=50.4 K 2023-11-13 04:54:33,102 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 848f42ca7f84405d8caa9069d14afbf7, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-13 04:54:33,102 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 8569b269c1334c84a54e2820cb6c2024, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-13 04:54:33,102 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting f86182dd16874789af7bd5e2534e152e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-13 04:54:33,102 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 8b884687547947a9bd9fa226b744d2cd, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-13 04:54:33,102 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 627cfda5c13e4b789ba8aa5aafde7dcd, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-13 04:54:33,102 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting e69ea8880373490388185806515ecf72, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-13 04:54:33,102 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 20e5b63b21774c5faf8c1cd4426ed0e2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-13 04:54:33,102 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 059d3c69dffb4c38b7c75c9037d38733, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-13 04:54:33,102 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting af27a6a5a02e4596bf8766a03254675d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-13 04:54:33,102 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 5ea2d00cb7d5458ba7af1b27a7e42dda_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-13 04:54:33,103 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-13 04:54:33,103 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:54:33,105 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512281eebd49c85ae4b2ab7e58ec3ae7925ed to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512281eebd49c85ae4b2ab7e58ec3ae7925ed 2023-11-13 04:54:33,106 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231cd71afa29d26496e8de73afd2c513269 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231cd71afa29d26496e8de73afd2c513269 2023-11-13 04:54:33,107 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101de86f65313cc48d3a51cf2e40983d633 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101de86f65313cc48d3a51cf2e40983d633 2023-11-13 04:54:33,108 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103f866f5efcd7941b399b0a0ac9de9d463 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103f866f5efcd7941b399b0a0ac9de9d463 2023-11-13 04:54:33,108 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-11-13 04:54:33,108 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-13 04:54:33,109 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-13 04:54:33,109 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-13 04:54:33,109 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-13 04:54:33,109 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-13 04:54:33,109 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-13 04:54:33,109 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-13 04:54:33,109 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-13 04:54:33,109 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-13 04:54:33,128 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] throttle.PressureAwareThroughputController(145): ce3aa54af75e8a2d70418cb3df223e32#family1#compaction#60 average throughput is 0.79 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-13 04:54:33,943 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/.tmp/family1/c9c7b65025084963945d8e1339df9c76 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/c9c7b65025084963945d8e1339df9c76 2023-11-13 04:54:33,949 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in ce3aa54af75e8a2d70418cb3df223e32/family1 of ce3aa54af75e8a2d70418cb3df223e32 into c9c7b65025084963945d8e1339df9c76(size=6.8 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-13 04:54:33,949 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for ce3aa54af75e8a2d70418cb3df223e32: 2023-11-13 04:54:33,949 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1699851273101; duration=0sec 2023-11-13 04:54:33,949 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-13 04:54:33,957 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512056b47dd10ccc34d0f832dabefdcbdb16d to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512056b47dd10ccc34d0f832dabefdcbdb16d 2023-11-13 04:54:33,958 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-13 04:54:33,980 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/6378c0ac4525443da4fd5c23f4daf853 first=Optional[r00] last=Optional[r2] 2023-11-13 04:54:33,981 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32., hostname=jenkins-hbase4.apache.org,41657,1699851201532, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/6378c0ac4525443da4fd5c23f4daf853}] 2023-11-13 04:54:33,983 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(763): Validating hfile at hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/6378c0ac4525443da4fd5c23f4daf853 for inclusion in ce3aa54af75e8a2d70418cb3df223e32/family1 2023-11-13 04:54:33,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-13 04:54:33,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(777): Region bounds: first= last= 2023-11-13 04:54:33,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HRegion(2446): Flush status journal for ce3aa54af75e8a2d70418cb3df223e32: 2023-11-13 04:54:33,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/6378c0ac4525443da4fd5c23f4daf853 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__nbune6onhbb6p336dr2j6llkq853kj1ctehm745ivhjod2fgu4t6o0n3bdc3nukr/family1/6378c0ac4525443da4fd5c23f4daf853 2023-11-13 04:54:33,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__nbune6onhbb6p336dr2j6llkq853kj1ctehm745ivhjod2fgu4t6o0n3bdc3nukr/family1/6378c0ac4525443da4fd5c23f4daf853 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/e4d1978e26d04158a280023215cfc647_SeqId_47_ 2023-11-13 04:54:33,988 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(849): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__nbune6onhbb6p336dr2j6llkq853kj1ctehm745ivhjod2fgu4t6o0n3bdc3nukr/family1/6378c0ac4525443da4fd5c23f4daf853 into ce3aa54af75e8a2d70418cb3df223e32/family1 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/e4d1978e26d04158a280023215cfc647_SeqId_47_ - updating store file list. 2023-11-13 04:54:33,991 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(882): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/e4d1978e26d04158a280023215cfc647_SeqId_47_ into ce3aa54af75e8a2d70418cb3df223e32/family1 2023-11-13 04:54:33,991 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(855): Successfully loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__nbune6onhbb6p336dr2j6llkq853kj1ctehm745ivhjod2fgu4t6o0n3bdc3nukr/family1/6378c0ac4525443da4fd5c23f4daf853 into ce3aa54af75e8a2d70418cb3df223e32/family1 (new location: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/e4d1978e26d04158a280023215cfc647_SeqId_47_) 2023-11-13 04:54:33,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__nbune6onhbb6p336dr2j6llkq853kj1ctehm745ivhjod2fgu4t6o0n3bdc3nukr/family1/6378c0ac4525443da4fd5c23f4daf853 2023-11-13 04:54:33,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-13 04:54:33,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-13 04:54:33,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(1912): ce3aa54af75e8a2d70418cb3df223e32/family1 is initiating minor compaction (all files) 2023-11-13 04:54:33,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@dd887ea; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-13 04:54:33,993 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of ce3aa54af75e8a2d70418cb3df223e32/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. 2023-11-13 04:54:33,993 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/a5ef79dfbbcc4a809036016ecccce36a, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/c9c7b65025084963945d8e1339df9c76, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/e4d1978e26d04158a280023215cfc647_SeqId_47_] into tmpdir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/.tmp, totalSize=390.1 K 2023-11-13 04:54:33,994 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting a5ef79dfbbcc4a809036016ecccce36a, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878824229 2023-11-13 04:54:33,994 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting c9c7b65025084963945d8e1339df9c76, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621224229 2023-11-13 04:54:33,995 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting e4d1978e26d04158a280023215cfc647_SeqId_47_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878824229 2023-11-13 04:54:33,995 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-13 04:54:33,996 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:54:33,997 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511306a6f55e669d242ee8576481f1578ea5a to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511306a6f55e669d242ee8576481f1578ea5a 2023-11-13 04:54:33,999 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512019ad6a1e2abea4ae9a704c1278ebfa5ab to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512019ad6a1e2abea4ae9a704c1278ebfa5ab 2023-11-13 04:54:34,000 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205ffa7e425b10f4bf7a8416f5261b6f21a to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205ffa7e425b10f4bf7a8416f5261b6f21a 2023-11-13 04:54:34,000 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-11-13 04:54:34,000 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-13 04:54:34,001 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-13 04:54:34,001 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-13 04:54:34,001 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-13 04:54:34,002 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-13 04:54:34,004 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.7980 sec 2023-11-13 04:54:34,011 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] throttle.PressureAwareThroughputController(145): ce3aa54af75e8a2d70418cb3df223e32#family1#compaction#61 average throughput is 25.80 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-13 04:54:34,038 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/848f42ca7f84405d8caa9069d14afbf7, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/8569b269c1334c84a54e2820cb6c2024, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/f86182dd16874789af7bd5e2534e152e, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/8b884687547947a9bd9fa226b744d2cd, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/627cfda5c13e4b789ba8aa5aafde7dcd, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/e69ea8880373490388185806515ecf72, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/20e5b63b21774c5faf8c1cd4426ed0e2, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/059d3c69dffb4c38b7c75c9037d38733, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/af27a6a5a02e4596bf8766a03254675d, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/5ea2d00cb7d5458ba7af1b27a7e42dda_SeqId_44_] to archive 2023-11-13 04:54:34,039 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:54:34,041 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/848f42ca7f84405d8caa9069d14afbf7 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/848f42ca7f84405d8caa9069d14afbf7 2023-11-13 04:54:34,042 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/8569b269c1334c84a54e2820cb6c2024 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/8569b269c1334c84a54e2820cb6c2024 2023-11-13 04:54:34,044 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/f86182dd16874789af7bd5e2534e152e to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/f86182dd16874789af7bd5e2534e152e 2023-11-13 04:54:34,045 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/8b884687547947a9bd9fa226b744d2cd to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/8b884687547947a9bd9fa226b744d2cd 2023-11-13 04:54:34,046 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/627cfda5c13e4b789ba8aa5aafde7dcd to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/627cfda5c13e4b789ba8aa5aafde7dcd 2023-11-13 04:54:34,047 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/e69ea8880373490388185806515ecf72 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/e69ea8880373490388185806515ecf72 2023-11-13 04:54:34,049 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/20e5b63b21774c5faf8c1cd4426ed0e2 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/20e5b63b21774c5faf8c1cd4426ed0e2 2023-11-13 04:54:34,050 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/059d3c69dffb4c38b7c75c9037d38733 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/059d3c69dffb4c38b7c75c9037d38733 2023-11-13 04:54:34,051 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/af27a6a5a02e4596bf8766a03254675d to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/af27a6a5a02e4596bf8766a03254675d 2023-11-13 04:54:34,053 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/5ea2d00cb7d5458ba7af1b27a7e42dda_SeqId_44_ to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/5ea2d00cb7d5458ba7af1b27a7e42dda_SeqId_44_ 2023-11-13 04:54:34,079 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-13 04:54:34,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure2.ProcedureExecutor(1028): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:34,490 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-13 04:54:34,491 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-11-13 04:54:34,491 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-13 04:54:34,493 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-11-13 04:54:34,496 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=ce3aa54af75e8a2d70418cb3df223e32, REOPEN/MOVE}] 2023-11-13 04:54:34,496 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=ce3aa54af75e8a2d70418cb3df223e32, REOPEN/MOVE 2023-11-13 04:54:34,497 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=ce3aa54af75e8a2d70418cb3df223e32, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:34,497 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699851274497"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699851274497"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699851274497"}]},"ts":"1699851274497"} 2023-11-13 04:54:34,498 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure ce3aa54af75e8a2d70418cb3df223e32, server=jenkins-hbase4.apache.org,41657,1699851201532}] 2023-11-13 04:54:34,649 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:34,650 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ce3aa54af75e8a2d70418cb3df223e32 2023-11-13 04:54:34,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ce3aa54af75e8a2d70418cb3df223e32, disabling compactions & flushes 2023-11-13 04:54:34,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. 2023-11-13 04:54:35,233 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/.tmp/family1/4cbafeae9cf94c2e84fb19924efe1647 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/4cbafeae9cf94c2e84fb19924efe1647 2023-11-13 04:54:35,237 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in ce3aa54af75e8a2d70418cb3df223e32/family1 of ce3aa54af75e8a2d70418cb3df223e32 into 4cbafeae9cf94c2e84fb19924efe1647(size=193.0 K), total size for store is 193.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-13 04:54:35,237 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for ce3aa54af75e8a2d70418cb3df223e32: 2023-11-13 04:54:35,237 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. 2023-11-13 04:54:35,237 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32., storeName=family1, fileCount=3, fileSize=390.1 K (191.4 K, 6.8 K, 191.8 K), priority=2, time=1699851273993; duration=1sec 2023-11-13 04:54:35,237 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. 2023-11-13 04:54:35,237 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. after waiting 0 ms 2023-11-13 04:54:35,237 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-13 04:54:35,237 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. 2023-11-13 04:54:35,238 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/a5ef79dfbbcc4a809036016ecccce36a, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/c9c7b65025084963945d8e1339df9c76, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/e4d1978e26d04158a280023215cfc647_SeqId_47_] to archive 2023-11-13 04:54:35,238 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:54:35,240 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/a5ef79dfbbcc4a809036016ecccce36a to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/a5ef79dfbbcc4a809036016ecccce36a 2023-11-13 04:54:35,241 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/c9c7b65025084963945d8e1339df9c76 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/c9c7b65025084963945d8e1339df9c76 2023-11-13 04:54:35,242 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/e4d1978e26d04158a280023215cfc647_SeqId_47_ to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/e4d1978e26d04158a280023215cfc647_SeqId_47_ 2023-11-13 04:54:35,247 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-13 04:54:35,248 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. 2023-11-13 04:54:35,248 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ce3aa54af75e8a2d70418cb3df223e32: 2023-11-13 04:54:35,248 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: ce3aa54af75e8a2d70418cb3df223e32 to self. 2023-11-13 04:54:35,249 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ce3aa54af75e8a2d70418cb3df223e32 2023-11-13 04:54:35,250 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=ce3aa54af75e8a2d70418cb3df223e32, regionState=CLOSED 2023-11-13 04:54:35,250 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699851275249"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699851275249"}]},"ts":"1699851275249"} 2023-11-13 04:54:35,252 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=45 2023-11-13 04:54:35,252 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure ce3aa54af75e8a2d70418cb3df223e32, server=jenkins-hbase4.apache.org,41657,1699851201532 in 753 msec 2023-11-13 04:54:35,252 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=ce3aa54af75e8a2d70418cb3df223e32, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,41657,1699851201532; forceNewPlan=false, retain=true 2023-11-13 04:54:35,403 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=ce3aa54af75e8a2d70418cb3df223e32, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:35,403 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699851275403"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699851275403"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699851275403"}]},"ts":"1699851275403"} 2023-11-13 04:54:35,404 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure ce3aa54af75e8a2d70418cb3df223e32, server=jenkins-hbase4.apache.org,41657,1699851201532}] 2023-11-13 04:54:35,556 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:35,558 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. 2023-11-13 04:54:35,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ce3aa54af75e8a2d70418cb3df223e32, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32.', STARTKEY => '', ENDKEY => ''} 2023-11-13 04:54:35,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly ce3aa54af75e8a2d70418cb3df223e32 2023-11-13 04:54:35,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-13 04:54:35,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ce3aa54af75e8a2d70418cb3df223e32 2023-11-13 04:54:35,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ce3aa54af75e8a2d70418cb3df223e32 2023-11-13 04:54:35,560 INFO [StoreOpener-ce3aa54af75e8a2d70418cb3df223e32-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ce3aa54af75e8a2d70418cb3df223e32 2023-11-13 04:54:35,561 DEBUG [StoreOpener-ce3aa54af75e8a2d70418cb3df223e32-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1 2023-11-13 04:54:35,561 DEBUG [StoreOpener-ce3aa54af75e8a2d70418cb3df223e32-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1 2023-11-13 04:54:35,561 INFO [StoreOpener-ce3aa54af75e8a2d70418cb3df223e32-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ce3aa54af75e8a2d70418cb3df223e32 columnFamilyName family1 2023-11-13 04:54:35,566 DEBUG [StoreOpener-ce3aa54af75e8a2d70418cb3df223e32-1] regionserver.HStore(539): loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/4cbafeae9cf94c2e84fb19924efe1647 2023-11-13 04:54:35,566 INFO [StoreOpener-ce3aa54af75e8a2d70418cb3df223e32-1] regionserver.HStore(310): Store=ce3aa54af75e8a2d70418cb3df223e32/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-13 04:54:35,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32 2023-11-13 04:54:35,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32 2023-11-13 04:54:35,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ce3aa54af75e8a2d70418cb3df223e32 2023-11-13 04:54:35,570 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ce3aa54af75e8a2d70418cb3df223e32; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64605040, jitterRate=-0.037309885025024414}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-13 04:54:35,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ce3aa54af75e8a2d70418cb3df223e32: 2023-11-13 04:54:35,571 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32., pid=47, masterSystemTime=1699851275556 2023-11-13 04:54:35,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. 2023-11-13 04:54:35,572 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. 2023-11-13 04:54:35,573 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=ce3aa54af75e8a2d70418cb3df223e32, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:35,573 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699851275573"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699851275573"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699851275573"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699851275573"}]},"ts":"1699851275573"} 2023-11-13 04:54:35,575 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=47, resume processing ppid=45 2023-11-13 04:54:35,575 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure ce3aa54af75e8a2d70418cb3df223e32, server=jenkins-hbase4.apache.org,41657,1699851201532 in 170 msec 2023-11-13 04:54:35,577 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=44 2023-11-13 04:54:35,577 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=ce3aa54af75e8a2d70418cb3df223e32, REOPEN/MOVE in 1.0790 sec 2023-11-13 04:54:35,579 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=43 2023-11-13 04:54:35,579 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.0840 sec 2023-11-13 04:54:35,580 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.5000 sec 2023-11-13 04:54:35,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=43 2023-11-13 04:54:35,582 INFO [Listener at localhost/34517] compactions.TestMobCompactor(278): alter status finished 2023-11-13 04:54:35,583 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33831] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:35,584 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-13 04:54:35,585 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-13 04:54:35,585 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-13 04:54:35,585 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699851875585 2023-11-13 04:54:35,586 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-13 04:54:35,587 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-13 04:54:35,587 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-13 04:54:35,589 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] zookeeper.ReadOnlyZKClient(139): Connect 0x5e3ee6e5 to 127.0.0.1:51072 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-13 04:54:35,593 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2bfd423b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-13 04:54:35,593 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-13 04:54:35,593 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-13 04:54:35,593 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-13 04:54:35,593 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-13 04:54:35,593 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-13 04:54:36,419 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128d041daaa8193422294ec292ef088701b to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128d041daaa8193422294ec292ef088701b 2023-11-13 04:54:36,420 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-13 04:54:36,433 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-13 04:54:36,434 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57528, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-13 04:54:36,440 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-13 04:54:36,442 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44680, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-13 04:54:36,449 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/9ae696e2e07b4307bbc830c6ae2a9afe first=Optional[r05] last=Optional[r8] 2023-11-13 04:54:36,449 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32., hostname=jenkins-hbase4.apache.org,41657,1699851201532, seqNum=51 for row with hfile group [{family1,hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/9ae696e2e07b4307bbc830c6ae2a9afe}] 2023-11-13 04:54:36,454 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(763): Validating hfile at hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/9ae696e2e07b4307bbc830c6ae2a9afe for inclusion in ce3aa54af75e8a2d70418cb3df223e32/family1 2023-11-13 04:54:36,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-13 04:54:36,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(777): Region bounds: first= last= 2023-11-13 04:54:36,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HRegion(2446): Flush status journal for ce3aa54af75e8a2d70418cb3df223e32: 2023-11-13 04:54:36,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/9ae696e2e07b4307bbc830c6ae2a9afe to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__5l5emqtkfigo0o20dn3kpnt77es94e1s86a1dpgvm2e6lev0ji0e30o0cetud2b2/family1/9ae696e2e07b4307bbc830c6ae2a9afe 2023-11-13 04:54:36,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__5l5emqtkfigo0o20dn3kpnt77es94e1s86a1dpgvm2e6lev0ji0e30o0cetud2b2/family1/9ae696e2e07b4307bbc830c6ae2a9afe as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/bc7c38e9904048f88805ae0bf8d4d7dc_SeqId_53_ 2023-11-13 04:54:36,459 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(849): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__5l5emqtkfigo0o20dn3kpnt77es94e1s86a1dpgvm2e6lev0ji0e30o0cetud2b2/family1/9ae696e2e07b4307bbc830c6ae2a9afe into ce3aa54af75e8a2d70418cb3df223e32/family1 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/bc7c38e9904048f88805ae0bf8d4d7dc_SeqId_53_ - updating store file list. 2023-11-13 04:54:36,463 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(882): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/bc7c38e9904048f88805ae0bf8d4d7dc_SeqId_53_ into ce3aa54af75e8a2d70418cb3df223e32/family1 2023-11-13 04:54:36,463 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(855): Successfully loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__5l5emqtkfigo0o20dn3kpnt77es94e1s86a1dpgvm2e6lev0ji0e30o0cetud2b2/family1/9ae696e2e07b4307bbc830c6ae2a9afe into ce3aa54af75e8a2d70418cb3df223e32/family1 (new location: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/bc7c38e9904048f88805ae0bf8d4d7dc_SeqId_53_) 2023-11-13 04:54:36,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__5l5emqtkfigo0o20dn3kpnt77es94e1s86a1dpgvm2e6lev0ji0e30o0cetud2b2/family1/9ae696e2e07b4307bbc830c6ae2a9afe 2023-11-13 04:54:36,465 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-13 04:54:36,465 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:54:36,467 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120e54f1aceb1dc4cbea4cf6f2fb1647460 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120e54f1aceb1dc4cbea4cf6f2fb1647460 2023-11-13 04:54:36,468 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128a8f006cf459d44c8a16b07cf36022916 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128a8f006cf459d44c8a16b07cf36022916 2023-11-13 04:54:36,468 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-11-13 04:54:36,468 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-13 04:54:36,468 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-13 04:54:36,468 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-13 04:54:36,469 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-13 04:54:36,469 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-13 04:54:36,469 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-13 04:54:36,469 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-13 04:54:36,471 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 885 msec 2023-11-13 04:54:36,531 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-13 04:54:36,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:36,941 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-11-13 04:54:36,942 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-13 04:54:36,942 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-11-13 04:54:36,944 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-11-13 04:54:36,946 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=ce3aa54af75e8a2d70418cb3df223e32, REOPEN/MOVE}] 2023-11-13 04:54:36,947 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=ce3aa54af75e8a2d70418cb3df223e32, REOPEN/MOVE 2023-11-13 04:54:36,947 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=ce3aa54af75e8a2d70418cb3df223e32, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:36,947 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699851276947"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699851276947"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699851276947"}]},"ts":"1699851276947"} 2023-11-13 04:54:36,949 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure ce3aa54af75e8a2d70418cb3df223e32, server=jenkins-hbase4.apache.org,41657,1699851201532}] 2023-11-13 04:54:37,100 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:37,101 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ce3aa54af75e8a2d70418cb3df223e32 2023-11-13 04:54:37,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ce3aa54af75e8a2d70418cb3df223e32, disabling compactions & flushes 2023-11-13 04:54:37,101 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. 2023-11-13 04:54:37,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. 2023-11-13 04:54:37,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. after waiting 0 ms 2023-11-13 04:54:37,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. 2023-11-13 04:54:37,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-11-13 04:54:37,107 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. 2023-11-13 04:54:37,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ce3aa54af75e8a2d70418cb3df223e32: 2023-11-13 04:54:37,107 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: ce3aa54af75e8a2d70418cb3df223e32 to self. 2023-11-13 04:54:37,108 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ce3aa54af75e8a2d70418cb3df223e32 2023-11-13 04:54:37,108 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=ce3aa54af75e8a2d70418cb3df223e32, regionState=CLOSED 2023-11-13 04:54:37,109 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699851277108"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699851277108"}]},"ts":"1699851277108"} 2023-11-13 04:54:37,111 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=52, resume processing ppid=51 2023-11-13 04:54:37,111 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure ce3aa54af75e8a2d70418cb3df223e32, server=jenkins-hbase4.apache.org,41657,1699851201532 in 161 msec 2023-11-13 04:54:37,111 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=ce3aa54af75e8a2d70418cb3df223e32, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,41657,1699851201532; forceNewPlan=false, retain=true 2023-11-13 04:54:37,262 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=ce3aa54af75e8a2d70418cb3df223e32, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:37,262 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699851277262"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699851277262"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699851277262"}]},"ts":"1699851277262"} 2023-11-13 04:54:37,263 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure ce3aa54af75e8a2d70418cb3df223e32, server=jenkins-hbase4.apache.org,41657,1699851201532}] 2023-11-13 04:54:37,415 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:37,417 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. 2023-11-13 04:54:37,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ce3aa54af75e8a2d70418cb3df223e32, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32.', STARTKEY => '', ENDKEY => ''} 2023-11-13 04:54:37,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly ce3aa54af75e8a2d70418cb3df223e32 2023-11-13 04:54:37,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-13 04:54:37,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ce3aa54af75e8a2d70418cb3df223e32 2023-11-13 04:54:37,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ce3aa54af75e8a2d70418cb3df223e32 2023-11-13 04:54:37,419 INFO [StoreOpener-ce3aa54af75e8a2d70418cb3df223e32-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ce3aa54af75e8a2d70418cb3df223e32 2023-11-13 04:54:37,420 DEBUG [StoreOpener-ce3aa54af75e8a2d70418cb3df223e32-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1 2023-11-13 04:54:37,420 DEBUG [StoreOpener-ce3aa54af75e8a2d70418cb3df223e32-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1 2023-11-13 04:54:37,420 INFO [StoreOpener-ce3aa54af75e8a2d70418cb3df223e32-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ce3aa54af75e8a2d70418cb3df223e32 columnFamilyName family1 2023-11-13 04:54:37,425 DEBUG [StoreOpener-ce3aa54af75e8a2d70418cb3df223e32-1] regionserver.HStore(539): loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/4cbafeae9cf94c2e84fb19924efe1647 2023-11-13 04:54:37,428 DEBUG [StoreOpener-ce3aa54af75e8a2d70418cb3df223e32-1] regionserver.HStore(539): loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/family1/bc7c38e9904048f88805ae0bf8d4d7dc_SeqId_53_ 2023-11-13 04:54:37,428 INFO [StoreOpener-ce3aa54af75e8a2d70418cb3df223e32-1] regionserver.HStore(310): Store=ce3aa54af75e8a2d70418cb3df223e32/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-13 04:54:37,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32 2023-11-13 04:54:37,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32 2023-11-13 04:54:37,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ce3aa54af75e8a2d70418cb3df223e32 2023-11-13 04:54:37,434 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ce3aa54af75e8a2d70418cb3df223e32; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68452607, jitterRate=0.02002333104610443}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-13 04:54:37,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ce3aa54af75e8a2d70418cb3df223e32: 2023-11-13 04:54:37,435 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32., pid=53, masterSystemTime=1699851277415 2023-11-13 04:54:37,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. 2023-11-13 04:54:37,436 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. 2023-11-13 04:54:37,437 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=ce3aa54af75e8a2d70418cb3df223e32, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:37,437 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699851277436"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699851277436"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699851277436"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699851277436"}]},"ts":"1699851277436"} 2023-11-13 04:54:37,439 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-11-13 04:54:37,439 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure ce3aa54af75e8a2d70418cb3df223e32, server=jenkins-hbase4.apache.org,41657,1699851201532 in 175 msec 2023-11-13 04:54:37,441 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=51, resume processing ppid=50 2023-11-13 04:54:37,441 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=ce3aa54af75e8a2d70418cb3df223e32, REOPEN/MOVE in 493 msec 2023-11-13 04:54:37,443 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=50, resume processing ppid=49 2023-11-13 04:54:37,443 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 497 msec 2023-11-13 04:54:37,444 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 912 msec 2023-11-13 04:54:37,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=49 2023-11-13 04:54:37,447 INFO [Listener at localhost/34517] compactions.TestMobCompactor(278): alter status finished 2023-11-13 04:54:37,447 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33831] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-13 04:54:37,449 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] procedure2.ProcedureExecutor(1028): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-13 04:54:37,450 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-13 04:54:37,450 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-13 04:54:37,450 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699851877450 2023-11-13 04:54:37,451 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-13 04:54:37,451 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-13 04:54:37,451 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-13 04:54:37,452 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] zookeeper.ReadOnlyZKClient(139): Connect 0x00f42e2b to 127.0.0.1:51072 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-13 04:54:37,457 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@41594894, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-13 04:54:37,457 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-13 04:54:37,457 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-13 04:54:37,457 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-13 04:54:37,457 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-13 04:54:37,457 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-13 04:54:37,457 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-13 04:54:37,458 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-13 04:54:37,458 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-13 04:54:37,458 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-13 04:54:37,458 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-13 04:54:37,459 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-13 04:54:37,460 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 11 msec 2023-11-13 04:54:37,506 INFO [Listener at localhost/34517] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=249 (was 259), OpenFileDescriptor=658 (was 648) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=112 (was 156), ProcessCount=169 (was 169), AvailableMemoryMB=2522 (was 2538) 2023-11-13 04:54:37,516 INFO [Listener at localhost/34517] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=249, OpenFileDescriptor=658, MaxFileDescriptor=60000, SystemLoadAverage=112, ProcessCount=169, AvailableMemoryMB=2522 2023-11-13 04:54:37,517 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-13 04:54:37,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure2.ProcedureExecutor(1028): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:37,519 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-11-13 04:54:37,519 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-11-13 04:54:37,520 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-13 04:54:37,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-13 04:54:37,521 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807 2023-11-13 04:54:37,522 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807 empty. 2023-11-13 04:54:37,522 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807 2023-11-13 04:54:37,522 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-11-13 04:54:37,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-13 04:54:37,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-13 04:54:37,930 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-11-13 04:54:37,931 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7675): creating {ENCODED => eab65722ecb84f0f65e150d916e14807, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp 2023-11-13 04:54:38,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-13 04:54:38,336 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-13 04:54:38,336 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1604): Closing eab65722ecb84f0f65e150d916e14807, disabling compactions & flushes 2023-11-13 04:54:38,337 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. 2023-11-13 04:54:38,337 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. 2023-11-13 04:54:38,337 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. after waiting 0 ms 2023-11-13 04:54:38,337 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. 2023-11-13 04:54:38,337 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. 2023-11-13 04:54:38,337 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1558): Region close journal for eab65722ecb84f0f65e150d916e14807: 2023-11-13 04:54:38,339 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-11-13 04:54:38,340 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699851278340"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699851278340"}]},"ts":"1699851278340"} 2023-11-13 04:54:38,341 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-13 04:54:38,341 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-13 04:54:38,342 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699851278342"}]},"ts":"1699851278342"} 2023-11-13 04:54:38,342 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-11-13 04:54:38,346 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=eab65722ecb84f0f65e150d916e14807, ASSIGN}] 2023-11-13 04:54:38,347 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=eab65722ecb84f0f65e150d916e14807, ASSIGN 2023-11-13 04:54:38,348 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=eab65722ecb84f0f65e150d916e14807, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41657,1699851201532; forceNewPlan=false, retain=false 2023-11-13 04:54:38,499 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=eab65722ecb84f0f65e150d916e14807, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:38,499 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699851278499"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699851278499"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699851278499"}]},"ts":"1699851278499"} 2023-11-13 04:54:38,501 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure eab65722ecb84f0f65e150d916e14807, server=jenkins-hbase4.apache.org,41657,1699851201532}] 2023-11-13 04:54:38,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-13 04:54:38,652 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:38,655 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. 2023-11-13 04:54:38,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => eab65722ecb84f0f65e150d916e14807, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807.', STARTKEY => '', ENDKEY => ''} 2023-11-13 04:54:38,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily eab65722ecb84f0f65e150d916e14807 2023-11-13 04:54:38,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-13 04:54:38,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for eab65722ecb84f0f65e150d916e14807 2023-11-13 04:54:38,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for eab65722ecb84f0f65e150d916e14807 2023-11-13 04:54:38,656 INFO [StoreOpener-eab65722ecb84f0f65e150d916e14807-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region eab65722ecb84f0f65e150d916e14807 2023-11-13 04:54:38,657 DEBUG [StoreOpener-eab65722ecb84f0f65e150d916e14807-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1 2023-11-13 04:54:38,658 DEBUG [StoreOpener-eab65722ecb84f0f65e150d916e14807-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1 2023-11-13 04:54:38,658 INFO [StoreOpener-eab65722ecb84f0f65e150d916e14807-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eab65722ecb84f0f65e150d916e14807 columnFamilyName family1 2023-11-13 04:54:38,659 INFO [StoreOpener-eab65722ecb84f0f65e150d916e14807-1] regionserver.HStore(310): Store=eab65722ecb84f0f65e150d916e14807/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-13 04:54:38,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807 2023-11-13 04:54:38,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807 2023-11-13 04:54:38,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for eab65722ecb84f0f65e150d916e14807 2023-11-13 04:54:38,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-13 04:54:38,665 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened eab65722ecb84f0f65e150d916e14807; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65914933, jitterRate=-0.017790958285331726}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-13 04:54:38,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for eab65722ecb84f0f65e150d916e14807: 2023-11-13 04:54:38,666 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807., pid=57, masterSystemTime=1699851278652 2023-11-13 04:54:38,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. 2023-11-13 04:54:38,667 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. 2023-11-13 04:54:38,667 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=eab65722ecb84f0f65e150d916e14807, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:38,668 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699851278667"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699851278667"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699851278667"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699851278667"}]},"ts":"1699851278667"} 2023-11-13 04:54:38,670 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=57, resume processing ppid=56 2023-11-13 04:54:38,670 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure eab65722ecb84f0f65e150d916e14807, server=jenkins-hbase4.apache.org,41657,1699851201532 in 168 msec 2023-11-13 04:54:38,671 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=56, resume processing ppid=55 2023-11-13 04:54:38,671 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=eab65722ecb84f0f65e150d916e14807, ASSIGN in 324 msec 2023-11-13 04:54:38,672 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-13 04:54:38,672 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699851278672"}]},"ts":"1699851278672"} 2023-11-13 04:54:38,673 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-11-13 04:54:38,676 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-11-13 04:54:38,677 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1590 sec 2023-11-13 04:54:39,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-13 04:54:39,624 INFO [Listener at localhost/34517] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-11-13 04:54:39,642 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:54:39,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:39,644 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-13 04:54:39,644 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:39,644 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-13 04:54:39,644 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-13 04:54:39,645 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:39,645 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:39,646 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:39,646 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:39,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:39,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:39,647 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:39,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:39,647 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:54:39,647 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:39,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:54:39,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:39,647 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:39,648 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:39,648 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-13 04:54:39,648 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:39,648 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-13 04:54:39,648 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:54:39,648 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:54:39,648 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. 2023-11-13 04:54:39,648 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. started... 2023-11-13 04:54:39,649 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing eab65722ecb84f0f65e150d916e14807 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-13 04:54:40,068 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130952c76ab701646979c1b16c5318ffd3b to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130952c76ab701646979c1b16c5318ffd3b 2023-11-13 04:54:40,471 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/.tmp/family1/70bbac03d2904f099d6bab054cb6e718 2023-11-13 04:54:40,477 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/.tmp/family1/70bbac03d2904f099d6bab054cb6e718 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/70bbac03d2904f099d6bab054cb6e718 2023-11-13 04:54:40,481 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/70bbac03d2904f099d6bab054cb6e718, entries=1000, sequenceid=5, filesize=190.5 K 2023-11-13 04:54:40,482 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for eab65722ecb84f0f65e150d916e14807 in 833ms, sequenceid=5, compaction requested=false 2023-11-13 04:54:40,482 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-13 04:54:40,483 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for eab65722ecb84f0f65e150d916e14807: 2023-11-13 04:54:40,483 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. 2023-11-13 04:54:40,483 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:54:40,483 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:54:40,483 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:40,483 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-13 04:54:40,483 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-13 04:54:40,485 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:40,485 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:40,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:40,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:40,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:40,485 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:40,485 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:54:40,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:40,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:40,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:40,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:40,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:40,487 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-13 04:54:40,487 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@172719b5[Count = 0] remaining members to acquire global barrier 2023-11-13 04:54:40,487 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-13 04:54:40,487 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:40,489 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:40,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:40,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:40,489 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-13 04:54:40,489 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-13 04:54:40,489 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:54:40,489 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:40,489 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:54:40,492 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-13 04:54:40,492 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:40,492 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:40,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:40,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:40,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:40,492 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-13 04:54:40,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:40,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:40,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:40,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:40,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:40,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:40,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:40,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:54:40,495 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-13 04:54:40,495 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-13 04:54:40,495 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:54:40,495 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:54:40,495 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:40,495 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:54:40,500 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:40,500 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:40,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:40,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:40,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:40,500 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:40,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:40,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:40,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:40,501 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:40,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:40,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:40,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:40,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:40,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:40,502 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:40,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:40,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:40,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:40,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:40,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:40,504 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:40,504 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:40,504 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:40,505 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:40,505 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:40,505 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:40,505 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-13 04:54:40,505 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:54:40,504 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:40,505 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:40,505 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:40,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:40,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:40,505 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:40,505 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-13 04:54:40,505 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:54:40,505 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-13 04:54:40,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:40,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:40,605 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:54:40,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:54:40,610 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:54:40,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-13 04:54:40,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:40,611 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-13 04:54:40,611 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:40,611 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-13 04:54:40,611 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-13 04:54:40,612 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:40,612 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:40,614 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:40,614 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:40,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:40,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:40,614 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:40,614 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:54:40,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:40,615 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:40,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:54:40,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:40,615 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:40,615 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-13 04:54:40,616 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:40,616 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-13 04:54:40,616 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:40,616 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-13 04:54:40,616 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:54:40,616 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:54:40,616 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. 2023-11-13 04:54:40,616 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. started... 2023-11-13 04:54:40,616 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing eab65722ecb84f0f65e150d916e14807 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-13 04:54:40,795 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-13 04:54:40,831 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-13 04:54:40,831 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3048c9dd to 127.0.0.1:51072 2023-11-13 04:54:40,831 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-13 04:54:40,832 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x00f42e2b to 127.0.0.1:51072 2023-11-13 04:54:40,832 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-13 04:54:40,832 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-13 04:54:40,832 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7817aa2d to 127.0.0.1:51072 2023-11-13 04:54:40,832 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-13 04:54:40,832 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-13 04:54:40,832 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x18adca1a to 127.0.0.1:51072 2023-11-13 04:54:40,832 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-13 04:54:40,833 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-13 04:54:40,833 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5e3ee6e5 to 127.0.0.1:51072 2023-11-13 04:54:40,833 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-13 04:54:41,027 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112856b3ff03ee3647d394514153094f39e0 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112856b3ff03ee3647d394514153094f39e0 2023-11-13 04:54:41,432 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/.tmp/family1/0e56304c638a48ff84c802a715b49fda 2023-11-13 04:54:41,437 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/.tmp/family1/0e56304c638a48ff84c802a715b49fda as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/0e56304c638a48ff84c802a715b49fda 2023-11-13 04:54:41,441 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/0e56304c638a48ff84c802a715b49fda, entries=1, sequenceid=9, filesize=5.0 K 2023-11-13 04:54:41,441 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for eab65722ecb84f0f65e150d916e14807 in 825ms, sequenceid=9, compaction requested=false 2023-11-13 04:54:41,442 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for eab65722ecb84f0f65e150d916e14807: 2023-11-13 04:54:41,442 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. 2023-11-13 04:54:41,442 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:54:41,442 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:54:41,442 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:41,442 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-13 04:54:41,442 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-13 04:54:41,444 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:41,444 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:41,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:41,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:41,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:41,444 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:41,444 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:54:41,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:41,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:41,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:41,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:41,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:41,446 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-13 04:54:41,446 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6ade004b[Count = 0] remaining members to acquire global barrier 2023-11-13 04:54:41,446 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-13 04:54:41,446 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:41,448 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:41,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:41,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:41,448 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-13 04:54:41,448 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-13 04:54:41,448 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:54:41,448 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:41,448 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:54:41,450 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:41,450 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-13 04:54:41,450 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:41,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:41,450 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-13 04:54:41,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:41,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:41,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:41,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:41,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:41,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:41,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:41,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:41,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:41,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:54:41,453 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-13 04:54:41,453 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-13 04:54:41,453 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:54:41,453 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:54:41,453 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:41,453 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:54:41,454 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:41,454 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:41,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:41,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:41,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:41,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:41,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:41,454 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:41,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:41,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:41,455 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:41,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:41,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:41,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:41,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:41,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:41,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:41,457 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:41,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:41,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:41,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:41,459 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:41,459 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:41,459 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:41,459 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:41,459 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:41,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:41,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:41,459 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:41,459 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-13 04:54:41,459 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:54:41,459 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:41,459 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:41,460 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:41,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:41,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:41,460 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:41,460 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-13 04:54:41,460 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:54:41,560 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:54:41,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:54:41,565 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:54:41,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-13 04:54:41,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:41,566 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-13 04:54:41,567 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:41,567 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-13 04:54:41,567 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-13 04:54:41,567 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:41,567 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:41,570 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:41,570 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:41,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:41,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:41,570 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:41,570 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:54:41,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:41,570 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:41,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:54:41,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:41,571 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:41,571 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-13 04:54:41,571 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:41,571 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-13 04:54:41,571 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:41,571 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-13 04:54:41,571 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:54:41,572 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:54:41,572 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. 2023-11-13 04:54:41,572 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. started... 2023-11-13 04:54:41,572 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing eab65722ecb84f0f65e150d916e14807 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:54:41,983 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201da3f3ec880144af799eb23639a1d94ee to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201da3f3ec880144af799eb23639a1d94ee 2023-11-13 04:54:42,388 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/.tmp/family1/d04092f82a8d41c4bcd4b2e77a8419d9 2023-11-13 04:54:42,393 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/.tmp/family1/d04092f82a8d41c4bcd4b2e77a8419d9 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/d04092f82a8d41c4bcd4b2e77a8419d9 2023-11-13 04:54:42,397 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/d04092f82a8d41c4bcd4b2e77a8419d9, entries=1, sequenceid=13, filesize=5.0 K 2023-11-13 04:54:42,398 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for eab65722ecb84f0f65e150d916e14807 in 826ms, sequenceid=13, compaction requested=true 2023-11-13 04:54:42,398 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for eab65722ecb84f0f65e150d916e14807: 2023-11-13 04:54:42,398 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. 2023-11-13 04:54:42,398 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:54:42,398 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:54:42,398 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:42,398 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-13 04:54:42,398 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-13 04:54:42,400 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:42,400 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:42,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:42,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:42,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:42,400 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:42,400 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:54:42,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:42,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:42,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:42,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:42,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:42,401 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-13 04:54:42,402 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6727aaf8[Count = 0] remaining members to acquire global barrier 2023-11-13 04:54:42,402 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-13 04:54:42,402 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:42,407 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:42,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:42,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:42,408 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-13 04:54:42,408 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-13 04:54:42,408 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:54:42,408 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:42,408 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:54:42,413 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-13 04:54:42,413 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:42,413 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:42,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:42,413 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-13 04:54:42,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:42,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:42,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:42,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:42,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:42,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:42,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:42,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:42,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:42,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:54:42,416 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-13 04:54:42,416 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-13 04:54:42,416 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:54:42,416 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:54:42,416 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:42,416 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:54:42,421 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:42,421 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:42,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:42,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:42,421 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:42,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:42,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:42,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:42,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:42,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:42,421 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:42,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:42,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:42,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:42,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:42,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:42,423 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:42,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:42,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:42,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:42,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:42,432 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:42,432 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:42,432 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:42,433 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:42,433 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:42,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:42,433 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-13 04:54:42,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:42,433 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:42,433 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-13 04:54:42,433 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:54:42,433 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:42,433 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:42,433 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:42,433 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:42,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:42,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:42,433 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-13 04:54:42,433 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:54:42,533 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:54:42,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:54:42,537 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:54:42,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-13 04:54:42,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:42,539 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-13 04:54:42,539 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:42,539 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-13 04:54:42,539 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-13 04:54:42,540 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:42,540 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:42,544 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:42,544 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:42,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:42,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:42,545 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:42,545 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:54:42,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:42,545 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:42,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:54:42,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:42,545 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:42,546 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-13 04:54:42,546 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:42,546 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-13 04:54:42,546 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:42,546 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-13 04:54:42,546 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:54:42,546 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:54:42,546 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. 2023-11-13 04:54:42,546 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. started... 2023-11-13 04:54:42,546 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing eab65722ecb84f0f65e150d916e14807 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:54:42,961 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205239921c4aedd47db9a92d247c3c251e3 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205239921c4aedd47db9a92d247c3c251e3 2023-11-13 04:54:43,366 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/.tmp/family1/18303ac949764f8f9b5a82894d3ee2d1 2023-11-13 04:54:43,371 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/.tmp/family1/18303ac949764f8f9b5a82894d3ee2d1 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/18303ac949764f8f9b5a82894d3ee2d1 2023-11-13 04:54:43,374 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/18303ac949764f8f9b5a82894d3ee2d1, entries=1, sequenceid=17, filesize=5.0 K 2023-11-13 04:54:43,375 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for eab65722ecb84f0f65e150d916e14807 in 829ms, sequenceid=17, compaction requested=true 2023-11-13 04:54:43,375 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for eab65722ecb84f0f65e150d916e14807: 2023-11-13 04:54:43,375 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. 2023-11-13 04:54:43,375 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:54:43,375 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:54:43,375 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:43,375 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-13 04:54:43,375 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-13 04:54:43,377 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:43,377 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:43,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:43,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:43,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:43,377 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:43,377 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:54:43,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:43,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:43,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:43,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:43,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:43,379 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-13 04:54:43,379 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@623400fb[Count = 0] remaining members to acquire global barrier 2023-11-13 04:54:43,379 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-13 04:54:43,379 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:43,380 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:43,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:43,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:43,381 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-13 04:54:43,381 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-13 04:54:43,381 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:54:43,381 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:43,381 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:54:43,382 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:43,382 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-13 04:54:43,382 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:43,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:43,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:43,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:43,382 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-13 04:54:43,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:43,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:43,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:43,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:43,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:43,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:43,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:43,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:54:43,384 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-13 04:54:43,384 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-13 04:54:43,385 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:54:43,385 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:54:43,385 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:43,385 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:54:43,388 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:43,388 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:43,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:43,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:43,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:43,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:43,388 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:43,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:43,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:43,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:43,388 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:43,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:43,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:43,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:43,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:43,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:43,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:43,390 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:43,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:43,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:43,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:43,392 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:43,392 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:43,392 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:43,392 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:43,392 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:43,392 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:43,392 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-13 04:54:43,392 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:54:43,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:43,392 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:43,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:43,393 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:43,393 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:43,393 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-13 04:54:43,393 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:43,393 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:54:43,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:43,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:43,493 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:54:43,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:54:43,497 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:54:43,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-13 04:54:43,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:43,499 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-13 04:54:43,499 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:43,499 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-13 04:54:43,499 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-13 04:54:43,500 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:43,500 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:43,501 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:43,501 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:43,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:43,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:43,501 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:43,501 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:54:43,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:43,502 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:43,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:54:43,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:43,502 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:43,503 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-13 04:54:43,503 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:43,503 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-13 04:54:43,503 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:43,503 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-13 04:54:43,505 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:54:43,505 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:54:43,505 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. 2023-11-13 04:54:43,505 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. started... 2023-11-13 04:54:43,505 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing eab65722ecb84f0f65e150d916e14807 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:54:43,919 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512282bbe481cd70348618ead8585e0a18e53 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512282bbe481cd70348618ead8585e0a18e53 2023-11-13 04:54:44,324 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/.tmp/family1/a4f565d96ba24ac4a1cc9bce9fe60197 2023-11-13 04:54:44,328 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/.tmp/family1/a4f565d96ba24ac4a1cc9bce9fe60197 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/a4f565d96ba24ac4a1cc9bce9fe60197 2023-11-13 04:54:44,332 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/a4f565d96ba24ac4a1cc9bce9fe60197, entries=1, sequenceid=21, filesize=5.0 K 2023-11-13 04:54:44,333 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for eab65722ecb84f0f65e150d916e14807 in 828ms, sequenceid=21, compaction requested=true 2023-11-13 04:54:44,333 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for eab65722ecb84f0f65e150d916e14807: 2023-11-13 04:54:44,333 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. 2023-11-13 04:54:44,333 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:54:44,333 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:54:44,333 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:44,333 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-13 04:54:44,333 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-13 04:54:44,335 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:44,335 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:44,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:44,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:44,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:44,335 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:44,336 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:54:44,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:44,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:44,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:44,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:44,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:44,337 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-13 04:54:44,337 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4df157b9[Count = 0] remaining members to acquire global barrier 2023-11-13 04:54:44,337 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-13 04:54:44,337 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:44,339 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:44,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:44,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:44,339 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-13 04:54:44,339 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-13 04:54:44,339 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:54:44,339 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:44,339 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:54:44,341 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:44,341 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-13 04:54:44,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:44,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:44,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:44,341 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:44,341 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-13 04:54:44,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:44,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:44,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:44,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:44,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:44,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:44,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:44,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:54:44,343 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-13 04:54:44,343 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-13 04:54:44,343 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:54:44,343 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:54:44,343 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:44,343 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:54:44,345 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:44,345 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:44,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:44,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:44,345 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:44,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:44,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:44,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:44,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:44,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:44,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:44,346 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:44,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:44,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:44,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:44,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:44,347 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:44,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:44,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:44,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:44,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:44,349 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:44,349 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:44,349 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:44,349 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:44,349 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:44,349 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-13 04:54:44,349 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:44,349 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-13 04:54:44,349 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:44,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:44,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:44,349 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:44,349 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:44,349 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:54:44,349 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:44,350 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-13 04:54:44,350 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:54:44,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:44,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:44,450 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:54:44,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:54:44,454 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:54:44,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-13 04:54:44,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:44,456 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-13 04:54:44,456 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:44,456 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-13 04:54:44,456 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-13 04:54:44,456 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:44,456 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:44,458 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:44,458 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:44,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:44,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:44,459 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:44,459 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:54:44,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:44,459 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:44,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:54:44,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:44,460 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:44,460 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-13 04:54:44,460 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:44,460 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-13 04:54:44,460 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:44,460 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-13 04:54:44,460 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:54:44,460 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:54:44,460 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. 2023-11-13 04:54:44,460 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. started... 2023-11-13 04:54:44,460 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing eab65722ecb84f0f65e150d916e14807 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:54:44,872 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231c9706bd66b4b4b87be2ca2bb368ddd3f to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231c9706bd66b4b4b87be2ca2bb368ddd3f 2023-11-13 04:54:45,277 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/.tmp/family1/768e3cdb2e64499f8406c311d714c33a 2023-11-13 04:54:45,281 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/.tmp/family1/768e3cdb2e64499f8406c311d714c33a as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/768e3cdb2e64499f8406c311d714c33a 2023-11-13 04:54:45,285 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/768e3cdb2e64499f8406c311d714c33a, entries=1, sequenceid=25, filesize=5.0 K 2023-11-13 04:54:45,286 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for eab65722ecb84f0f65e150d916e14807 in 826ms, sequenceid=25, compaction requested=true 2023-11-13 04:54:45,286 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for eab65722ecb84f0f65e150d916e14807: 2023-11-13 04:54:45,286 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. 2023-11-13 04:54:45,286 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:54:45,286 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:54:45,286 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:45,286 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-13 04:54:45,286 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-13 04:54:45,287 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:45,287 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:45,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:45,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:45,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:45,288 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:45,288 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:54:45,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:45,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:45,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:45,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:45,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:45,289 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-13 04:54:45,289 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5737da14[Count = 0] remaining members to acquire global barrier 2023-11-13 04:54:45,289 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-13 04:54:45,289 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:45,290 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:45,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:45,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:45,291 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-13 04:54:45,291 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-13 04:54:45,291 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:54:45,291 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:45,291 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:54:45,292 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-13 04:54:45,292 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:45,292 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:45,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:45,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:45,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:45,292 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-13 04:54:45,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:45,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:45,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:45,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:45,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:45,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:45,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:45,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:54:45,295 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-13 04:54:45,295 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-13 04:54:45,295 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:54:45,295 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:54:45,295 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:45,295 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:54:45,297 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:45,297 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:45,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:45,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:45,297 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:45,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:45,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:45,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:45,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:45,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:45,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:45,298 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:45,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:45,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:45,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:45,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:45,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:45,299 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:45,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:45,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:45,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:45,301 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:45,301 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:45,301 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:45,301 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-13 04:54:45,302 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:54:45,301 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:45,301 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:45,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:45,301 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:45,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:45,302 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-13 04:54:45,302 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:54:45,302 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:45,302 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:45,302 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:45,302 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:45,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:45,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:45,402 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:54:45,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:54:45,406 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:54:45,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-13 04:54:45,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:45,408 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-13 04:54:45,408 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:45,408 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-13 04:54:45,408 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-13 04:54:45,408 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:45,408 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:45,409 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:45,410 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:45,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:45,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:45,410 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:45,410 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:54:45,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:45,410 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:45,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:54:45,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:45,411 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:45,411 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-13 04:54:45,411 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:45,411 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-13 04:54:45,411 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:45,411 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-13 04:54:45,411 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:54:45,411 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:54:45,411 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. 2023-11-13 04:54:45,411 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. started... 2023-11-13 04:54:45,411 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing eab65722ecb84f0f65e150d916e14807 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:54:45,823 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101cefcd0e50b7946f79f0a381552cb9545 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101cefcd0e50b7946f79f0a381552cb9545 2023-11-13 04:54:46,228 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/.tmp/family1/20e19662e5504f8c88a8ef7c1ddd2773 2023-11-13 04:54:46,233 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/.tmp/family1/20e19662e5504f8c88a8ef7c1ddd2773 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/20e19662e5504f8c88a8ef7c1ddd2773 2023-11-13 04:54:46,238 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/20e19662e5504f8c88a8ef7c1ddd2773, entries=1, sequenceid=29, filesize=5.0 K 2023-11-13 04:54:46,239 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for eab65722ecb84f0f65e150d916e14807 in 828ms, sequenceid=29, compaction requested=true 2023-11-13 04:54:46,239 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for eab65722ecb84f0f65e150d916e14807: 2023-11-13 04:54:46,239 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. 2023-11-13 04:54:46,239 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:54:46,239 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:54:46,239 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:46,240 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-13 04:54:46,240 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-13 04:54:46,242 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:46,242 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:46,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:46,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:46,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:46,242 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:46,242 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:54:46,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:46,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:46,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:46,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:46,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:46,243 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-13 04:54:46,243 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d1dca60[Count = 0] remaining members to acquire global barrier 2023-11-13 04:54:46,243 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-13 04:54:46,244 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:46,246 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:46,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:46,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:46,246 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-13 04:54:46,246 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-13 04:54:46,246 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:54:46,246 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:46,246 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:54:46,247 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:46,247 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-13 04:54:46,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:46,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:46,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:46,248 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:46,248 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-13 04:54:46,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:46,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:46,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:46,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:46,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:46,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:46,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:46,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:54:46,250 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-13 04:54:46,250 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-13 04:54:46,250 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:54:46,250 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:54:46,250 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:46,250 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:54:46,252 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:46,252 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:46,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:46,252 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:46,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:46,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:46,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:46,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:46,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:46,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:46,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:46,253 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:46,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:46,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:46,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:46,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:46,254 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:46,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:46,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:46,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:46,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:46,257 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:46,257 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:46,257 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:46,257 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:46,257 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:46,257 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:46,257 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:46,257 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:46,257 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:46,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:46,257 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-13 04:54:46,257 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:54:46,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:46,257 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:46,257 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-13 04:54:46,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:46,258 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-13 04:54:46,258 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:54:46,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:46,358 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:54:46,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:54:46,362 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:54:46,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-13 04:54:46,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:46,364 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-13 04:54:46,364 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:46,364 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-13 04:54:46,364 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-13 04:54:46,365 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:46,365 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:46,367 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:46,367 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:46,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:46,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:46,368 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:46,368 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:54:46,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:46,368 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:46,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:54:46,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:46,368 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:46,369 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-13 04:54:46,369 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:46,369 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-13 04:54:46,369 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:46,369 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-13 04:54:46,369 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:54:46,369 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:54:46,369 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. 2023-11-13 04:54:46,369 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. started... 2023-11-13 04:54:46,369 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing eab65722ecb84f0f65e150d916e14807 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:54:46,783 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010314e09d67c5564112ab62a067f260e99d to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010314e09d67c5564112ab62a067f260e99d 2023-11-13 04:54:47,189 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/.tmp/family1/01d6573751174294ad7b0c6ce74e18ca 2023-11-13 04:54:47,193 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/.tmp/family1/01d6573751174294ad7b0c6ce74e18ca as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/01d6573751174294ad7b0c6ce74e18ca 2023-11-13 04:54:47,197 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/01d6573751174294ad7b0c6ce74e18ca, entries=1, sequenceid=33, filesize=5.0 K 2023-11-13 04:54:47,197 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for eab65722ecb84f0f65e150d916e14807 in 828ms, sequenceid=33, compaction requested=true 2023-11-13 04:54:47,197 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for eab65722ecb84f0f65e150d916e14807: 2023-11-13 04:54:47,197 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. 2023-11-13 04:54:47,197 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:54:47,198 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:54:47,198 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:47,198 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-13 04:54:47,198 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-13 04:54:47,199 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:47,199 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:47,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:47,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:47,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:47,200 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:47,200 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:54:47,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:47,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:47,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:47,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:47,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:47,201 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-13 04:54:47,201 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4fec20e0[Count = 0] remaining members to acquire global barrier 2023-11-13 04:54:47,201 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-13 04:54:47,201 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:47,207 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:47,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:47,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:47,208 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-13 04:54:47,208 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-13 04:54:47,208 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:54:47,208 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:47,208 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:54:47,213 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:47,214 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-13 04:54:47,214 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:47,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:47,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:47,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:47,214 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-13 04:54:47,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:47,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:47,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:47,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:47,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:47,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:47,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:47,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:54:47,216 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-13 04:54:47,216 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-13 04:54:47,216 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:54:47,216 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:54:47,216 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:47,216 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:54:47,217 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:47,217 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:47,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:47,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:47,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:47,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:47,217 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:47,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:47,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:47,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:47,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:47,218 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:47,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:47,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:47,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:47,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:47,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:47,219 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:47,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:47,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:47,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:47,221 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:47,221 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:47,221 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:47,221 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-13 04:54:47,221 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:54:47,221 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:47,221 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-13 04:54:47,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:47,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:47,221 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:47,221 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:47,222 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-13 04:54:47,222 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:54:47,221 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:47,222 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:47,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:47,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:47,222 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:47,222 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:47,322 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:54:47,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:54:47,326 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:54:47,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-13 04:54:47,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:47,328 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-13 04:54:47,328 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:47,328 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-13 04:54:47,328 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-13 04:54:47,329 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:47,329 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:47,330 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:47,330 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:47,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:47,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:47,330 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:47,330 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:54:47,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:47,331 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:47,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:54:47,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:47,331 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:47,331 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-13 04:54:47,332 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:47,332 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-13 04:54:47,332 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:47,332 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-13 04:54:47,332 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:54:47,332 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:54:47,332 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. 2023-11-13 04:54:47,332 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. started... 2023-11-13 04:54:47,332 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing eab65722ecb84f0f65e150d916e14807 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:54:47,749 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509074277aca9c243467da219cc5ddff1648b to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201509074277aca9c243467da219cc5ddff1648b 2023-11-13 04:54:48,154 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/.tmp/family1/b00d5f1864924fcdb925d4f8c2d7f0de 2023-11-13 04:54:48,158 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/.tmp/family1/b00d5f1864924fcdb925d4f8c2d7f0de as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/b00d5f1864924fcdb925d4f8c2d7f0de 2023-11-13 04:54:48,162 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/b00d5f1864924fcdb925d4f8c2d7f0de, entries=1, sequenceid=37, filesize=5.0 K 2023-11-13 04:54:48,163 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for eab65722ecb84f0f65e150d916e14807 in 831ms, sequenceid=37, compaction requested=true 2023-11-13 04:54:48,163 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for eab65722ecb84f0f65e150d916e14807: 2023-11-13 04:54:48,163 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. 2023-11-13 04:54:48,163 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:54:48,163 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:54:48,163 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:48,163 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-13 04:54:48,163 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-13 04:54:48,165 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:48,165 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:48,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:48,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:48,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:48,165 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:48,165 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:54:48,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:48,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:48,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:48,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:48,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:48,167 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-13 04:54:48,167 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@867ea3b[Count = 0] remaining members to acquire global barrier 2023-11-13 04:54:48,167 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-13 04:54:48,167 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:48,168 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:48,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:48,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:48,168 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-13 04:54:48,168 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-13 04:54:48,168 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:54:48,168 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:48,168 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:54:48,171 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:48,171 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-13 04:54:48,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:48,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:48,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:48,171 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:48,171 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-13 04:54:48,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:48,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:48,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:48,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:48,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:48,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:48,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:48,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:54:48,173 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-13 04:54:48,173 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-13 04:54:48,174 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:54:48,174 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:54:48,174 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:48,174 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:54:48,175 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:48,175 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:48,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:48,175 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:48,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:48,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:48,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:48,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:48,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:48,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:48,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:48,176 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:48,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:48,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:48,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:48,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:48,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:48,177 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:48,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:48,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:48,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:48,180 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:48,180 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:48,180 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:48,180 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:48,180 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-13 04:54:48,180 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:54:48,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:48,180 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:48,180 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:48,180 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:48,180 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:48,180 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:48,180 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:48,180 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:48,180 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-13 04:54:48,180 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:48,180 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:54:48,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:48,281 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:54:48,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:54:48,285 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:54:48,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-13 04:54:48,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:48,286 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-13 04:54:48,286 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:48,286 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-13 04:54:48,286 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-13 04:54:48,287 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:48,287 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:48,288 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:48,288 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:48,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:48,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:48,289 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:48,289 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:54:48,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:48,289 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:48,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:54:48,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:48,289 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:48,290 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-13 04:54:48,290 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:48,290 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-13 04:54:48,290 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:54:48,290 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-13 04:54:48,290 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:54:48,290 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:54:48,290 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. 2023-11-13 04:54:48,290 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. started... 2023-11-13 04:54:48,290 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing eab65722ecb84f0f65e150d916e14807 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:54:48,702 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120e01f0d9cacc74df6aa80857f868283ff to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120e01f0d9cacc74df6aa80857f868283ff 2023-11-13 04:54:49,107 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/.tmp/family1/886cffa49b0040d29c0a36d31dfdf0dc 2023-11-13 04:54:49,111 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/.tmp/family1/886cffa49b0040d29c0a36d31dfdf0dc as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/886cffa49b0040d29c0a36d31dfdf0dc 2023-11-13 04:54:49,115 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/886cffa49b0040d29c0a36d31dfdf0dc, entries=1, sequenceid=41, filesize=5.0 K 2023-11-13 04:54:49,116 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for eab65722ecb84f0f65e150d916e14807 in 826ms, sequenceid=41, compaction requested=true 2023-11-13 04:54:49,116 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for eab65722ecb84f0f65e150d916e14807: 2023-11-13 04:54:49,116 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. 2023-11-13 04:54:49,116 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:54:49,116 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:54:49,116 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:49,116 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-13 04:54:49,116 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-13 04:54:49,118 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:49,118 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:49,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:49,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:49,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:49,119 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:49,119 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:54:49,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:49,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:49,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:49,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:49,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:49,120 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-13 04:54:49,120 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@61697659[Count = 0] remaining members to acquire global barrier 2023-11-13 04:54:49,120 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-13 04:54:49,120 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:49,121 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:49,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:49,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:49,121 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-13 04:54:49,121 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-13 04:54:49,121 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:54:49,121 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:49,122 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:54:49,123 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:49,123 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-13 04:54:49,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:49,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:49,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:49,123 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:49,123 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-13 04:54:49,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:49,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:49,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:49,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:49,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:49,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:49,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:49,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:54:49,125 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-13 04:54:49,125 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-13 04:54:49,125 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:54:49,125 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:54:49,125 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:49,125 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:54:49,131 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:49,131 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:49,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:49,131 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:49,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:49,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:49,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:54:49,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:54:49,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:49,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:49,131 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:49,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:54:49,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:49,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:49,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:54:49,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:49,132 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:49,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:49,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:54:49,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:49,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:49,135 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:49,135 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:54:49,135 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:49,135 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:54:49,135 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:54:49,135 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-13 04:54:49,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:54:49,135 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-13 04:54:49,135 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:54:49,135 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:49,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:54:49,135 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:49,135 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:49,135 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:49,135 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:49,135 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-13 04:54:49,136 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:54:49,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:54:49,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:54:49,236 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:54:49,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:54:49,237 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33831] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:49,238 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] procedure2.ProcedureExecutor(1028): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-13 04:54:49,239 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-13 04:54:49,240 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-13 04:54:49,240 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699851889240 2023-11-13 04:54:49,242 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-13 04:54:49,243 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-13 04:54:49,243 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-13 04:54:49,244 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] zookeeper.ReadOnlyZKClient(139): Connect 0x413bd812 to 127.0.0.1:51072 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-13 04:54:49,248 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6694cb40, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-13 04:54:49,248 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-13 04:54:49,695 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103e848828c5c3648b78c72522e49f08039 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103e848828c5c3648b78c72522e49f08039 2023-11-13 04:54:49,696 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-13 04:54:49,708 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-13 04:54:49,709 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35078, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-13 04:54:49,716 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-13 04:54:49,717 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47384, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-13 04:54:49,727 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/36fc4c0371554f3186ebf2fa1b3cddd7 first=Optional[r3] last=Optional[r6] 2023-11-13 04:54:49,727 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807., hostname=jenkins-hbase4.apache.org,41657,1699851201532, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/36fc4c0371554f3186ebf2fa1b3cddd7}] 2023-11-13 04:54:49,731 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(763): Validating hfile at hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/36fc4c0371554f3186ebf2fa1b3cddd7 for inclusion in eab65722ecb84f0f65e150d916e14807/family1 2023-11-13 04:54:49,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-13 04:54:49,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(777): Region bounds: first= last= 2023-11-13 04:54:49,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HRegion(2446): Flush status journal for eab65722ecb84f0f65e150d916e14807: 2023-11-13 04:54:49,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/36fc4c0371554f3186ebf2fa1b3cddd7 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__rv13qpknjdpn9mj8s8k64n816c7hb78ddlukj2ct4gaef3o8oatdk0l7j7kttr08/family1/36fc4c0371554f3186ebf2fa1b3cddd7 2023-11-13 04:54:49,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__rv13qpknjdpn9mj8s8k64n816c7hb78ddlukj2ct4gaef3o8oatdk0l7j7kttr08/family1/36fc4c0371554f3186ebf2fa1b3cddd7 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/d4849e51f1be45849d5db0b776a1024b_SeqId_44_ 2023-11-13 04:54:49,736 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(849): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__rv13qpknjdpn9mj8s8k64n816c7hb78ddlukj2ct4gaef3o8oatdk0l7j7kttr08/family1/36fc4c0371554f3186ebf2fa1b3cddd7 into eab65722ecb84f0f65e150d916e14807/family1 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/d4849e51f1be45849d5db0b776a1024b_SeqId_44_ - updating store file list. 2023-11-13 04:54:49,739 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(882): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/d4849e51f1be45849d5db0b776a1024b_SeqId_44_ into eab65722ecb84f0f65e150d916e14807/family1 2023-11-13 04:54:49,739 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(855): Successfully loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__rv13qpknjdpn9mj8s8k64n816c7hb78ddlukj2ct4gaef3o8oatdk0l7j7kttr08/family1/36fc4c0371554f3186ebf2fa1b3cddd7 into eab65722ecb84f0f65e150d916e14807/family1 (new location: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/d4849e51f1be45849d5db0b776a1024b_SeqId_44_) 2023-11-13 04:54:49,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__rv13qpknjdpn9mj8s8k64n816c7hb78ddlukj2ct4gaef3o8oatdk0l7j7kttr08/family1/36fc4c0371554f3186ebf2fa1b3cddd7 2023-11-13 04:54:49,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-13 04:54:49,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-13 04:54:49,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(1912): eab65722ecb84f0f65e150d916e14807/family1 is initiating minor compaction 2023-11-13 04:54:49,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@20c4a8a8; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-13 04:54:49,742 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of eab65722ecb84f0f65e150d916e14807/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. 2023-11-13 04:54:49,742 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/0e56304c638a48ff84c802a715b49fda, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/d04092f82a8d41c4bcd4b2e77a8419d9, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/18303ac949764f8f9b5a82894d3ee2d1, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/a4f565d96ba24ac4a1cc9bce9fe60197, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/768e3cdb2e64499f8406c311d714c33a, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/20e19662e5504f8c88a8ef7c1ddd2773, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/01d6573751174294ad7b0c6ce74e18ca, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/b00d5f1864924fcdb925d4f8c2d7f0de, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/886cffa49b0040d29c0a36d31dfdf0dc, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/d4849e51f1be45849d5db0b776a1024b_SeqId_44_] into tmpdir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/.tmp, totalSize=50.3 K 2023-11-13 04:54:49,742 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 0e56304c638a48ff84c802a715b49fda, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-13 04:54:49,742 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting d04092f82a8d41c4bcd4b2e77a8419d9, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-13 04:54:49,742 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 18303ac949764f8f9b5a82894d3ee2d1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-13 04:54:49,742 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting a4f565d96ba24ac4a1cc9bce9fe60197, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-13 04:54:49,742 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 768e3cdb2e64499f8406c311d714c33a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-13 04:54:49,742 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 20e19662e5504f8c88a8ef7c1ddd2773, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-13 04:54:49,742 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 01d6573751174294ad7b0c6ce74e18ca, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-13 04:54:49,742 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting b00d5f1864924fcdb925d4f8c2d7f0de, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-13 04:54:49,743 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 886cffa49b0040d29c0a36d31dfdf0dc, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-13 04:54:49,743 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting d4849e51f1be45849d5db0b776a1024b_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-13 04:54:49,744 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-13 04:54:49,744 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:54:49,746 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512282bbe481cd70348618ead8585e0a18e53 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512282bbe481cd70348618ead8585e0a18e53 2023-11-13 04:54:49,747 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231c9706bd66b4b4b87be2ca2bb368ddd3f to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231c9706bd66b4b4b87be2ca2bb368ddd3f 2023-11-13 04:54:49,748 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101cefcd0e50b7946f79f0a381552cb9545 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101cefcd0e50b7946f79f0a381552cb9545 2023-11-13 04:54:49,749 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010314e09d67c5564112ab62a067f260e99d to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010314e09d67c5564112ab62a067f260e99d 2023-11-13 04:54:49,749 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-11-13 04:54:49,749 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-13 04:54:49,749 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-13 04:54:49,749 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-13 04:54:49,749 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-13 04:54:49,749 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-13 04:54:49,750 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-13 04:54:49,750 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-13 04:54:49,750 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-13 04:54:49,750 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-13 04:54:49,775 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] throttle.PressureAwareThroughputController(145): eab65722ecb84f0f65e150d916e14807#family1#compaction#72 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-13 04:54:50,196 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/.tmp/family1/180ed688cf724d738f062d54bb4b0783 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/180ed688cf724d738f062d54bb4b0783 2023-11-13 04:54:50,201 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in eab65722ecb84f0f65e150d916e14807/family1 of eab65722ecb84f0f65e150d916e14807 into 180ed688cf724d738f062d54bb4b0783(size=6.8 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-13 04:54:50,201 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for eab65722ecb84f0f65e150d916e14807: 2023-11-13 04:54:50,201 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1699851289742; duration=0sec 2023-11-13 04:54:50,201 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-13 04:54:50,239 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/0e56304c638a48ff84c802a715b49fda, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/d04092f82a8d41c4bcd4b2e77a8419d9, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/18303ac949764f8f9b5a82894d3ee2d1, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/a4f565d96ba24ac4a1cc9bce9fe60197, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/768e3cdb2e64499f8406c311d714c33a, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/20e19662e5504f8c88a8ef7c1ddd2773, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/01d6573751174294ad7b0c6ce74e18ca, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/b00d5f1864924fcdb925d4f8c2d7f0de, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/886cffa49b0040d29c0a36d31dfdf0dc, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/d4849e51f1be45849d5db0b776a1024b_SeqId_44_] to archive 2023-11-13 04:54:50,240 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:54:50,242 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/0e56304c638a48ff84c802a715b49fda to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/0e56304c638a48ff84c802a715b49fda 2023-11-13 04:54:50,243 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/d04092f82a8d41c4bcd4b2e77a8419d9 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/d04092f82a8d41c4bcd4b2e77a8419d9 2023-11-13 04:54:50,244 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/18303ac949764f8f9b5a82894d3ee2d1 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/18303ac949764f8f9b5a82894d3ee2d1 2023-11-13 04:54:50,245 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/a4f565d96ba24ac4a1cc9bce9fe60197 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/a4f565d96ba24ac4a1cc9bce9fe60197 2023-11-13 04:54:50,246 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/768e3cdb2e64499f8406c311d714c33a to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/768e3cdb2e64499f8406c311d714c33a 2023-11-13 04:54:50,247 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/20e19662e5504f8c88a8ef7c1ddd2773 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/20e19662e5504f8c88a8ef7c1ddd2773 2023-11-13 04:54:50,248 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/01d6573751174294ad7b0c6ce74e18ca to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/01d6573751174294ad7b0c6ce74e18ca 2023-11-13 04:54:50,249 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/b00d5f1864924fcdb925d4f8c2d7f0de to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/b00d5f1864924fcdb925d4f8c2d7f0de 2023-11-13 04:54:50,250 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/886cffa49b0040d29c0a36d31dfdf0dc to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/886cffa49b0040d29c0a36d31dfdf0dc 2023-11-13 04:54:50,251 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/d4849e51f1be45849d5db0b776a1024b_SeqId_44_ to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/d4849e51f1be45849d5db0b776a1024b_SeqId_44_ 2023-11-13 04:54:50,601 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120533f13332179b47e18bd466c6bffac9cd to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120533f13332179b47e18bd466c6bffac9cd 2023-11-13 04:54:50,602 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-13 04:54:50,623 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/996b9047989c40ab97740cf1d3d381aa first=Optional[r00] last=Optional[r2] 2023-11-13 04:54:50,623 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807., hostname=jenkins-hbase4.apache.org,41657,1699851201532, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/996b9047989c40ab97740cf1d3d381aa}] 2023-11-13 04:54:50,625 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(763): Validating hfile at hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/996b9047989c40ab97740cf1d3d381aa for inclusion in eab65722ecb84f0f65e150d916e14807/family1 2023-11-13 04:54:50,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-13 04:54:50,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(777): Region bounds: first= last= 2023-11-13 04:54:50,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HRegion(2446): Flush status journal for eab65722ecb84f0f65e150d916e14807: 2023-11-13 04:54:50,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/996b9047989c40ab97740cf1d3d381aa to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__h36aqgj1h8eigb6hg2h5m182u2j7aijkameoeq48r3s809o2ne0difof9o4drmhk/family1/996b9047989c40ab97740cf1d3d381aa 2023-11-13 04:54:50,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__h36aqgj1h8eigb6hg2h5m182u2j7aijkameoeq48r3s809o2ne0difof9o4drmhk/family1/996b9047989c40ab97740cf1d3d381aa as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/5f0af63986df4f1e9e7c1e4926a9d484_SeqId_47_ 2023-11-13 04:54:50,632 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(849): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__h36aqgj1h8eigb6hg2h5m182u2j7aijkameoeq48r3s809o2ne0difof9o4drmhk/family1/996b9047989c40ab97740cf1d3d381aa into eab65722ecb84f0f65e150d916e14807/family1 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/5f0af63986df4f1e9e7c1e4926a9d484_SeqId_47_ - updating store file list. 2023-11-13 04:54:50,636 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(882): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/5f0af63986df4f1e9e7c1e4926a9d484_SeqId_47_ into eab65722ecb84f0f65e150d916e14807/family1 2023-11-13 04:54:50,636 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(855): Successfully loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__h36aqgj1h8eigb6hg2h5m182u2j7aijkameoeq48r3s809o2ne0difof9o4drmhk/family1/996b9047989c40ab97740cf1d3d381aa into eab65722ecb84f0f65e150d916e14807/family1 (new location: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/5f0af63986df4f1e9e7c1e4926a9d484_SeqId_47_) 2023-11-13 04:54:50,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__h36aqgj1h8eigb6hg2h5m182u2j7aijkameoeq48r3s809o2ne0difof9o4drmhk/family1/996b9047989c40ab97740cf1d3d381aa 2023-11-13 04:54:50,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-13 04:54:50,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-13 04:54:50,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(1912): eab65722ecb84f0f65e150d916e14807/family1 is initiating minor compaction (all files) 2023-11-13 04:54:50,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7b49944b; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-13 04:54:50,638 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of eab65722ecb84f0f65e150d916e14807/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. 2023-11-13 04:54:50,638 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/70bbac03d2904f099d6bab054cb6e718, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/180ed688cf724d738f062d54bb4b0783, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/5f0af63986df4f1e9e7c1e4926a9d484_SeqId_47_] into tmpdir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/.tmp, totalSize=388.1 K 2023-11-13 04:54:50,638 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 70bbac03d2904f099d6bab054cb6e718, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878824229 2023-11-13 04:54:50,639 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 180ed688cf724d738f062d54bb4b0783, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621224229 2023-11-13 04:54:50,639 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 5f0af63986df4f1e9e7c1e4926a9d484_SeqId_47_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878824229 2023-11-13 04:54:50,639 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-13 04:54:50,640 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:54:50,641 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130952c76ab701646979c1b16c5318ffd3b to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130952c76ab701646979c1b16c5318ffd3b 2023-11-13 04:54:50,642 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201da3f3ec880144af799eb23639a1d94ee to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201da3f3ec880144af799eb23639a1d94ee 2023-11-13 04:54:50,643 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205239921c4aedd47db9a92d247c3c251e3 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205239921c4aedd47db9a92d247c3c251e3 2023-11-13 04:54:50,644 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-11-13 04:54:50,644 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-13 04:54:50,644 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-13 04:54:50,644 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-13 04:54:50,644 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-13 04:54:50,645 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-13 04:54:50,646 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.4070 sec 2023-11-13 04:54:50,653 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] throttle.PressureAwareThroughputController(145): eab65722ecb84f0f65e150d916e14807#family1#compaction#73 average throughput is 29.94 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-13 04:54:50,708 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-13 04:54:50,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure2.ProcedureExecutor(1028): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:51,117 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-13 04:54:51,118 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-11-13 04:54:51,118 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-13 04:54:51,119 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-11-13 04:54:51,122 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=eab65722ecb84f0f65e150d916e14807, REOPEN/MOVE}] 2023-11-13 04:54:51,122 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=eab65722ecb84f0f65e150d916e14807, REOPEN/MOVE 2023-11-13 04:54:51,123 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=eab65722ecb84f0f65e150d916e14807, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:51,123 WARN [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33831] assignment.AssignmentManager(1312): Unable to acquire lock for regionNode state=CLOSING, location=jenkins-hbase4.apache.org,41657,1699851201532, table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=eab65722ecb84f0f65e150d916e14807. It is likely that another thread is currently holding the lock. To avoid deadlock, skip execution for now. 2023-11-13 04:54:51,123 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699851291123"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699851291123"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699851291123"}]},"ts":"1699851291123"} 2023-11-13 04:54:51,124 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure eab65722ecb84f0f65e150d916e14807, server=jenkins-hbase4.apache.org,41657,1699851201532}] 2023-11-13 04:54:51,276 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:51,276 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close eab65722ecb84f0f65e150d916e14807 2023-11-13 04:54:51,276 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing eab65722ecb84f0f65e150d916e14807, disabling compactions & flushes 2023-11-13 04:54:51,276 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. 2023-11-13 04:54:51,868 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/.tmp/family1/9caabb64f52e487da7c2eccb38ccd4d8 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/9caabb64f52e487da7c2eccb38ccd4d8 2023-11-13 04:54:51,872 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in eab65722ecb84f0f65e150d916e14807/family1 of eab65722ecb84f0f65e150d916e14807 into 9caabb64f52e487da7c2eccb38ccd4d8(size=192.0 K), total size for store is 192.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-13 04:54:51,872 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for eab65722ecb84f0f65e150d916e14807: 2023-11-13 04:54:51,872 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. 2023-11-13 04:54:51,873 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807., storeName=family1, fileCount=3, fileSize=388.1 K (190.5 K, 6.8 K, 190.9 K), priority=2, time=1699851290638; duration=1sec 2023-11-13 04:54:51,873 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. 2023-11-13 04:54:51,873 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. after waiting 0 ms 2023-11-13 04:54:51,873 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-13 04:54:51,873 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. 2023-11-13 04:54:51,875 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/70bbac03d2904f099d6bab054cb6e718, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/180ed688cf724d738f062d54bb4b0783, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/5f0af63986df4f1e9e7c1e4926a9d484_SeqId_47_] to archive 2023-11-13 04:54:51,876 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:54:51,877 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/70bbac03d2904f099d6bab054cb6e718 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/70bbac03d2904f099d6bab054cb6e718 2023-11-13 04:54:51,878 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/180ed688cf724d738f062d54bb4b0783 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/180ed688cf724d738f062d54bb4b0783 2023-11-13 04:54:51,879 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/5f0af63986df4f1e9e7c1e4926a9d484_SeqId_47_ to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/5f0af63986df4f1e9e7c1e4926a9d484_SeqId_47_ 2023-11-13 04:54:51,883 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-13 04:54:51,884 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. 2023-11-13 04:54:51,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for eab65722ecb84f0f65e150d916e14807: 2023-11-13 04:54:51,884 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: eab65722ecb84f0f65e150d916e14807 to self. 2023-11-13 04:54:51,885 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed eab65722ecb84f0f65e150d916e14807 2023-11-13 04:54:51,885 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=eab65722ecb84f0f65e150d916e14807, regionState=CLOSED 2023-11-13 04:54:51,886 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699851291885"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699851291885"}]},"ts":"1699851291885"} 2023-11-13 04:54:51,888 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=62, resume processing ppid=61 2023-11-13 04:54:51,888 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure eab65722ecb84f0f65e150d916e14807, server=jenkins-hbase4.apache.org,41657,1699851201532 in 762 msec 2023-11-13 04:54:51,888 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=eab65722ecb84f0f65e150d916e14807, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,41657,1699851201532; forceNewPlan=false, retain=true 2023-11-13 04:54:52,038 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=eab65722ecb84f0f65e150d916e14807, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:52,039 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699851292038"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699851292038"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699851292038"}]},"ts":"1699851292038"} 2023-11-13 04:54:52,040 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure eab65722ecb84f0f65e150d916e14807, server=jenkins-hbase4.apache.org,41657,1699851201532}] 2023-11-13 04:54:52,191 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:52,194 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. 2023-11-13 04:54:52,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => eab65722ecb84f0f65e150d916e14807, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807.', STARTKEY => '', ENDKEY => ''} 2023-11-13 04:54:52,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily eab65722ecb84f0f65e150d916e14807 2023-11-13 04:54:52,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-13 04:54:52,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for eab65722ecb84f0f65e150d916e14807 2023-11-13 04:54:52,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for eab65722ecb84f0f65e150d916e14807 2023-11-13 04:54:52,196 INFO [StoreOpener-eab65722ecb84f0f65e150d916e14807-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region eab65722ecb84f0f65e150d916e14807 2023-11-13 04:54:52,197 DEBUG [StoreOpener-eab65722ecb84f0f65e150d916e14807-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1 2023-11-13 04:54:52,197 DEBUG [StoreOpener-eab65722ecb84f0f65e150d916e14807-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1 2023-11-13 04:54:52,197 INFO [StoreOpener-eab65722ecb84f0f65e150d916e14807-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eab65722ecb84f0f65e150d916e14807 columnFamilyName family1 2023-11-13 04:54:52,202 DEBUG [StoreOpener-eab65722ecb84f0f65e150d916e14807-1] regionserver.HStore(539): loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/9caabb64f52e487da7c2eccb38ccd4d8 2023-11-13 04:54:52,202 INFO [StoreOpener-eab65722ecb84f0f65e150d916e14807-1] regionserver.HStore(310): Store=eab65722ecb84f0f65e150d916e14807/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-13 04:54:52,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807 2023-11-13 04:54:52,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807 2023-11-13 04:54:52,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for eab65722ecb84f0f65e150d916e14807 2023-11-13 04:54:52,207 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened eab65722ecb84f0f65e150d916e14807; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62884825, jitterRate=-0.06294308602809906}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-13 04:54:52,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for eab65722ecb84f0f65e150d916e14807: 2023-11-13 04:54:52,208 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807., pid=63, masterSystemTime=1699851292191 2023-11-13 04:54:52,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. 2023-11-13 04:54:52,209 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. 2023-11-13 04:54:52,209 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=eab65722ecb84f0f65e150d916e14807, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:52,210 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699851292209"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699851292209"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699851292209"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699851292209"}]},"ts":"1699851292209"} 2023-11-13 04:54:52,212 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=63, resume processing ppid=61 2023-11-13 04:54:52,212 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure eab65722ecb84f0f65e150d916e14807, server=jenkins-hbase4.apache.org,41657,1699851201532 in 171 msec 2023-11-13 04:54:52,213 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=60 2023-11-13 04:54:52,213 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=eab65722ecb84f0f65e150d916e14807, REOPEN/MOVE in 1.0900 sec 2023-11-13 04:54:52,215 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-11-13 04:54:52,215 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.0950 sec 2023-11-13 04:54:52,217 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.5080 sec 2023-11-13 04:54:52,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=59 2023-11-13 04:54:52,219 INFO [Listener at localhost/34517] compactions.TestMobCompactor(278): alter status finished 2023-11-13 04:54:52,220 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33831] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:52,222 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-13 04:54:52,223 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-13 04:54:52,223 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699851892223 2023-11-13 04:54:52,224 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-13 04:54:52,224 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-13 04:54:52,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-13 04:54:52,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-13 04:54:52,226 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] zookeeper.ReadOnlyZKClient(139): Connect 0x454a5356 to 127.0.0.1:51072 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-13 04:54:52,231 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d56b4cc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-13 04:54:52,231 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-13 04:54:52,231 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-13 04:54:52,231 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-13 04:54:52,231 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-13 04:54:52,231 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-13 04:54:53,054 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128514bd0d14d5544a2a97300e72730b5a5 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128514bd0d14d5544a2a97300e72730b5a5 2023-11-13 04:54:53,055 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-13 04:54:53,073 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-13 04:54:53,074 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35088, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-13 04:54:53,081 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-13 04:54:53,082 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47400, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-13 04:54:53,090 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/94b29fb90bd0414d86cfe766be344571 first=Optional[r05] last=Optional[r8] 2023-11-13 04:54:53,091 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807., hostname=jenkins-hbase4.apache.org,41657,1699851201532, seqNum=51 for row with hfile group [{family1,hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/94b29fb90bd0414d86cfe766be344571}] 2023-11-13 04:54:53,095 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(763): Validating hfile at hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/94b29fb90bd0414d86cfe766be344571 for inclusion in eab65722ecb84f0f65e150d916e14807/family1 2023-11-13 04:54:53,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-13 04:54:53,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(777): Region bounds: first= last= 2023-11-13 04:54:53,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HRegion(2446): Flush status journal for eab65722ecb84f0f65e150d916e14807: 2023-11-13 04:54:53,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/94b29fb90bd0414d86cfe766be344571 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__m46icd4hb7f4rvjjl6emlpks3f6mmn6lhrn3m3vn17kg507dvfb10r491763ims4/family1/94b29fb90bd0414d86cfe766be344571 2023-11-13 04:54:53,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__m46icd4hb7f4rvjjl6emlpks3f6mmn6lhrn3m3vn17kg507dvfb10r491763ims4/family1/94b29fb90bd0414d86cfe766be344571 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/fa547cbdd0cf4589b65fde3ef7458428_SeqId_53_ 2023-11-13 04:54:53,101 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(849): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__m46icd4hb7f4rvjjl6emlpks3f6mmn6lhrn3m3vn17kg507dvfb10r491763ims4/family1/94b29fb90bd0414d86cfe766be344571 into eab65722ecb84f0f65e150d916e14807/family1 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/fa547cbdd0cf4589b65fde3ef7458428_SeqId_53_ - updating store file list. 2023-11-13 04:54:53,105 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(882): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/fa547cbdd0cf4589b65fde3ef7458428_SeqId_53_ into eab65722ecb84f0f65e150d916e14807/family1 2023-11-13 04:54:53,105 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(855): Successfully loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__m46icd4hb7f4rvjjl6emlpks3f6mmn6lhrn3m3vn17kg507dvfb10r491763ims4/family1/94b29fb90bd0414d86cfe766be344571 into eab65722ecb84f0f65e150d916e14807/family1 (new location: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/fa547cbdd0cf4589b65fde3ef7458428_SeqId_53_) 2023-11-13 04:54:53,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__m46icd4hb7f4rvjjl6emlpks3f6mmn6lhrn3m3vn17kg507dvfb10r491763ims4/family1/94b29fb90bd0414d86cfe766be344571 2023-11-13 04:54:53,107 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-13 04:54:53,108 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:54:53,109 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120e01f0d9cacc74df6aa80857f868283ff to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120e01f0d9cacc74df6aa80857f868283ff 2023-11-13 04:54:53,110 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112856b3ff03ee3647d394514153094f39e0 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112856b3ff03ee3647d394514153094f39e0 2023-11-13 04:54:53,110 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-11-13 04:54:53,110 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-13 04:54:53,110 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-13 04:54:53,110 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-13 04:54:53,110 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-13 04:54:53,110 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-13 04:54:53,111 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-13 04:54:53,111 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-13 04:54:53,112 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 891 msec 2023-11-13 04:54:53,156 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-11-13 04:54:53,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:53,565 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-11-13 04:54:53,566 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-13 04:54:53,566 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-11-13 04:54:53,568 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-11-13 04:54:53,570 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=eab65722ecb84f0f65e150d916e14807, REOPEN/MOVE}] 2023-11-13 04:54:53,571 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=eab65722ecb84f0f65e150d916e14807, REOPEN/MOVE 2023-11-13 04:54:53,571 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=eab65722ecb84f0f65e150d916e14807, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:53,571 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699851293571"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699851293571"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699851293571"}]},"ts":"1699851293571"} 2023-11-13 04:54:53,572 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure eab65722ecb84f0f65e150d916e14807, server=jenkins-hbase4.apache.org,41657,1699851201532}] 2023-11-13 04:54:53,723 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:53,724 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close eab65722ecb84f0f65e150d916e14807 2023-11-13 04:54:53,724 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing eab65722ecb84f0f65e150d916e14807, disabling compactions & flushes 2023-11-13 04:54:53,724 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. 2023-11-13 04:54:53,724 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. 2023-11-13 04:54:53,724 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. after waiting 0 ms 2023-11-13 04:54:53,724 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. 2023-11-13 04:54:53,730 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-11-13 04:54:53,730 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. 2023-11-13 04:54:53,730 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for eab65722ecb84f0f65e150d916e14807: 2023-11-13 04:54:53,730 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: eab65722ecb84f0f65e150d916e14807 to self. 2023-11-13 04:54:53,732 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed eab65722ecb84f0f65e150d916e14807 2023-11-13 04:54:53,732 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=eab65722ecb84f0f65e150d916e14807, regionState=CLOSED 2023-11-13 04:54:53,732 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699851293732"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699851293732"}]},"ts":"1699851293732"} 2023-11-13 04:54:53,734 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=68, resume processing ppid=67 2023-11-13 04:54:53,734 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure eab65722ecb84f0f65e150d916e14807, server=jenkins-hbase4.apache.org,41657,1699851201532 in 161 msec 2023-11-13 04:54:53,735 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=eab65722ecb84f0f65e150d916e14807, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,41657,1699851201532; forceNewPlan=false, retain=true 2023-11-13 04:54:53,885 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=eab65722ecb84f0f65e150d916e14807, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:53,885 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699851293885"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699851293885"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699851293885"}]},"ts":"1699851293885"} 2023-11-13 04:54:53,886 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure eab65722ecb84f0f65e150d916e14807, server=jenkins-hbase4.apache.org,41657,1699851201532}] 2023-11-13 04:54:54,038 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:54,040 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. 2023-11-13 04:54:54,041 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => eab65722ecb84f0f65e150d916e14807, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807.', STARTKEY => '', ENDKEY => ''} 2023-11-13 04:54:54,041 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily eab65722ecb84f0f65e150d916e14807 2023-11-13 04:54:54,041 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-13 04:54:54,041 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for eab65722ecb84f0f65e150d916e14807 2023-11-13 04:54:54,041 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for eab65722ecb84f0f65e150d916e14807 2023-11-13 04:54:54,042 INFO [StoreOpener-eab65722ecb84f0f65e150d916e14807-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region eab65722ecb84f0f65e150d916e14807 2023-11-13 04:54:54,043 DEBUG [StoreOpener-eab65722ecb84f0f65e150d916e14807-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1 2023-11-13 04:54:54,043 DEBUG [StoreOpener-eab65722ecb84f0f65e150d916e14807-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1 2023-11-13 04:54:54,043 INFO [StoreOpener-eab65722ecb84f0f65e150d916e14807-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eab65722ecb84f0f65e150d916e14807 columnFamilyName family1 2023-11-13 04:54:54,048 DEBUG [StoreOpener-eab65722ecb84f0f65e150d916e14807-1] regionserver.HStore(539): loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/9caabb64f52e487da7c2eccb38ccd4d8 2023-11-13 04:54:54,051 DEBUG [StoreOpener-eab65722ecb84f0f65e150d916e14807-1] regionserver.HStore(539): loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/family1/fa547cbdd0cf4589b65fde3ef7458428_SeqId_53_ 2023-11-13 04:54:54,051 INFO [StoreOpener-eab65722ecb84f0f65e150d916e14807-1] regionserver.HStore(310): Store=eab65722ecb84f0f65e150d916e14807/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-13 04:54:54,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807 2023-11-13 04:54:54,053 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807 2023-11-13 04:54:54,055 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for eab65722ecb84f0f65e150d916e14807 2023-11-13 04:54:54,056 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened eab65722ecb84f0f65e150d916e14807; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68993300, jitterRate=0.028080284595489502}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-13 04:54:54,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for eab65722ecb84f0f65e150d916e14807: 2023-11-13 04:54:54,056 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807., pid=69, masterSystemTime=1699851294038 2023-11-13 04:54:54,057 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. 2023-11-13 04:54:54,057 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. 2023-11-13 04:54:54,058 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=eab65722ecb84f0f65e150d916e14807, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:54,058 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699851294058"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699851294058"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699851294058"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699851294058"}]},"ts":"1699851294058"} 2023-11-13 04:54:54,060 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-11-13 04:54:54,060 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure eab65722ecb84f0f65e150d916e14807, server=jenkins-hbase4.apache.org,41657,1699851201532 in 173 msec 2023-11-13 04:54:54,061 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=67, resume processing ppid=66 2023-11-13 04:54:54,061 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=eab65722ecb84f0f65e150d916e14807, REOPEN/MOVE in 490 msec 2023-11-13 04:54:54,063 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=66, resume processing ppid=65 2023-11-13 04:54:54,063 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 494 msec 2023-11-13 04:54:54,064 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 907 msec 2023-11-13 04:54:54,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=65 2023-11-13 04:54:54,066 INFO [Listener at localhost/34517] compactions.TestMobCompactor(278): alter status finished 2023-11-13 04:54:54,067 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33831] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-13 04:54:54,068 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] procedure2.ProcedureExecutor(1028): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-13 04:54:54,069 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-13 04:54:54,069 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-13 04:54:54,069 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699851894069 2023-11-13 04:54:54,073 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-13 04:54:54,073 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-13 04:54:54,073 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-13 04:54:54,075 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] zookeeper.ReadOnlyZKClient(139): Connect 0x77d430c4 to 127.0.0.1:51072 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-13 04:54:54,079 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@644ca83, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-13 04:54:54,079 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-13 04:54:54,080 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-13 04:54:54,080 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-13 04:54:54,080 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-13 04:54:54,080 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-13 04:54:54,080 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-13 04:54:54,080 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-13 04:54:54,080 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-13 04:54:54,080 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-13 04:54:54,080 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-13 04:54:54,081 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-13 04:54:54,082 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 14 msec 2023-11-13 04:54:54,128 INFO [Listener at localhost/34517] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=243 (was 249), OpenFileDescriptor=653 (was 658), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=87 (was 112), ProcessCount=169 (was 169), AvailableMemoryMB=2478 (was 2522) 2023-11-13 04:54:54,142 INFO [Listener at localhost/34517] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=243, OpenFileDescriptor=653, MaxFileDescriptor=60000, SystemLoadAverage=87, ProcessCount=169, AvailableMemoryMB=2477 2023-11-13 04:54:54,145 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-13 04:54:54,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-11-13 04:54:54,147 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-11-13 04:54:54,147 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-11-13 04:54:54,147 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-13 04:54:54,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-13 04:54:54,148 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd 2023-11-13 04:54:54,149 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd empty. 2023-11-13 04:54:54,149 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd 2023-11-13 04:54:54,149 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-11-13 04:54:54,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-13 04:54:54,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-13 04:54:54,556 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-11-13 04:54:54,557 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => d7273cd7ceac381f4e9d7eb10ecae3cd, NAME => 'testGetAfterCompaction,,1699851294144.d7273cd7ceac381f4e9d7eb10ecae3cd.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp 2023-11-13 04:54:54,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-13 04:54:54,963 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1699851294144.d7273cd7ceac381f4e9d7eb10ecae3cd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-13 04:54:54,963 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1604): Closing d7273cd7ceac381f4e9d7eb10ecae3cd, disabling compactions & flushes 2023-11-13 04:54:54,963 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1699851294144.d7273cd7ceac381f4e9d7eb10ecae3cd. 2023-11-13 04:54:54,963 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1699851294144.d7273cd7ceac381f4e9d7eb10ecae3cd. 2023-11-13 04:54:54,963 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1699851294144.d7273cd7ceac381f4e9d7eb10ecae3cd. after waiting 0 ms 2023-11-13 04:54:54,963 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1699851294144.d7273cd7ceac381f4e9d7eb10ecae3cd. 2023-11-13 04:54:54,963 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1699851294144.d7273cd7ceac381f4e9d7eb10ecae3cd. 2023-11-13 04:54:54,963 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1558): Region close journal for d7273cd7ceac381f4e9d7eb10ecae3cd: 2023-11-13 04:54:54,965 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-11-13 04:54:54,966 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1699851294144.d7273cd7ceac381f4e9d7eb10ecae3cd.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1699851294966"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699851294966"}]},"ts":"1699851294966"} 2023-11-13 04:54:54,967 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-13 04:54:54,968 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-13 04:54:54,968 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699851294968"}]},"ts":"1699851294968"} 2023-11-13 04:54:54,969 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-11-13 04:54:54,972 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=d7273cd7ceac381f4e9d7eb10ecae3cd, ASSIGN}] 2023-11-13 04:54:54,973 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=d7273cd7ceac381f4e9d7eb10ecae3cd, ASSIGN 2023-11-13 04:54:54,974 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=d7273cd7ceac381f4e9d7eb10ecae3cd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41657,1699851201532; forceNewPlan=false, retain=false 2023-11-13 04:54:55,125 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=d7273cd7ceac381f4e9d7eb10ecae3cd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:55,125 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1699851294144.d7273cd7ceac381f4e9d7eb10ecae3cd.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1699851295125"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699851295125"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699851295125"}]},"ts":"1699851295125"} 2023-11-13 04:54:55,126 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure d7273cd7ceac381f4e9d7eb10ecae3cd, server=jenkins-hbase4.apache.org,41657,1699851201532}] 2023-11-13 04:54:55,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-13 04:54:55,278 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:55,280 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testGetAfterCompaction,,1699851294144.d7273cd7ceac381f4e9d7eb10ecae3cd. 2023-11-13 04:54:55,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d7273cd7ceac381f4e9d7eb10ecae3cd, NAME => 'testGetAfterCompaction,,1699851294144.d7273cd7ceac381f4e9d7eb10ecae3cd.', STARTKEY => '', ENDKEY => ''} 2023-11-13 04:54:55,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-11-13 04:54:55,282 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-11-13 04:54:55,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction d7273cd7ceac381f4e9d7eb10ecae3cd 2023-11-13 04:54:55,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1699851294144.d7273cd7ceac381f4e9d7eb10ecae3cd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-13 04:54:55,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d7273cd7ceac381f4e9d7eb10ecae3cd 2023-11-13 04:54:55,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d7273cd7ceac381f4e9d7eb10ecae3cd 2023-11-13 04:54:55,284 INFO [StoreOpener-d7273cd7ceac381f4e9d7eb10ecae3cd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d7273cd7ceac381f4e9d7eb10ecae3cd 2023-11-13 04:54:55,285 DEBUG [StoreOpener-d7273cd7ceac381f4e9d7eb10ecae3cd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1 2023-11-13 04:54:55,285 DEBUG [StoreOpener-d7273cd7ceac381f4e9d7eb10ecae3cd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1 2023-11-13 04:54:55,285 INFO [StoreOpener-d7273cd7ceac381f4e9d7eb10ecae3cd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d7273cd7ceac381f4e9d7eb10ecae3cd columnFamilyName f1 2023-11-13 04:54:55,287 INFO [StoreOpener-d7273cd7ceac381f4e9d7eb10ecae3cd-1] regionserver.HStore(310): Store=d7273cd7ceac381f4e9d7eb10ecae3cd/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-13 04:54:55,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd 2023-11-13 04:54:55,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd 2023-11-13 04:54:55,290 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d7273cd7ceac381f4e9d7eb10ecae3cd 2023-11-13 04:54:55,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-13 04:54:55,292 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d7273cd7ceac381f4e9d7eb10ecae3cd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60657539, jitterRate=-0.09613223373889923}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-13 04:54:55,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d7273cd7ceac381f4e9d7eb10ecae3cd: 2023-11-13 04:54:55,293 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testGetAfterCompaction,,1699851294144.d7273cd7ceac381f4e9d7eb10ecae3cd., pid=73, masterSystemTime=1699851295278 2023-11-13 04:54:55,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testGetAfterCompaction,,1699851294144.d7273cd7ceac381f4e9d7eb10ecae3cd. 2023-11-13 04:54:55,295 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testGetAfterCompaction,,1699851294144.d7273cd7ceac381f4e9d7eb10ecae3cd. 2023-11-13 04:54:55,295 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=d7273cd7ceac381f4e9d7eb10ecae3cd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:55,295 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1699851294144.d7273cd7ceac381f4e9d7eb10ecae3cd.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1699851295295"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699851295295"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699851295295"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699851295295"}]},"ts":"1699851295295"} 2023-11-13 04:54:55,298 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=73, resume processing ppid=72 2023-11-13 04:54:55,298 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure d7273cd7ceac381f4e9d7eb10ecae3cd, server=jenkins-hbase4.apache.org,41657,1699851201532 in 170 msec 2023-11-13 04:54:55,299 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-11-13 04:54:55,299 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=d7273cd7ceac381f4e9d7eb10ecae3cd, ASSIGN in 326 msec 2023-11-13 04:54:55,299 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-13 04:54:55,300 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699851295299"}]},"ts":"1699851295299"} 2023-11-13 04:54:55,300 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-11-13 04:54:55,304 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-11-13 04:54:55,305 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 1.1590 sec 2023-11-13 04:54:56,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-13 04:54:56,252 INFO [Listener at localhost/34517] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-11-13 04:54:56,252 DEBUG [Listener at localhost/34517] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-11-13 04:54:56,254 INFO [Listener at localhost/34517] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-11-13 04:54:56,257 INFO [Listener at localhost/34517] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-11-13 04:54:56,258 INFO [Listener at localhost/34517] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-11-13 04:54:56,258 INFO [Listener at localhost/34517] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-11-13 04:54:56,262 INFO [Listener at localhost/34517] regionserver.HRegion(2745): Flushing d7273cd7ceac381f4e9d7eb10ecae3cd 1/1 column families, dataSize=37 B heapSize=368 B 2023-11-13 04:54:56,675 INFO [Listener at localhost/34517] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311139e483824a78942c69a48b6632da57c61 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311139e483824a78942c69a48b6632da57c61 2023-11-13 04:54:57,081 INFO [Listener at localhost/34517] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/.tmp/f1/88a8bf21ae8345718016cfb9988b89a9 2023-11-13 04:54:57,086 DEBUG [Listener at localhost/34517] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/.tmp/f1/88a8bf21ae8345718016cfb9988b89a9 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/88a8bf21ae8345718016cfb9988b89a9 2023-11-13 04:54:57,090 INFO [Listener at localhost/34517] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/88a8bf21ae8345718016cfb9988b89a9, entries=1, sequenceid=5, filesize=4.9 K 2023-11-13 04:54:57,091 INFO [Listener at localhost/34517] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for d7273cd7ceac381f4e9d7eb10ecae3cd in 829ms, sequenceid=5, compaction requested=false 2023-11-13 04:54:57,091 DEBUG [Listener at localhost/34517] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-11-13 04:54:57,092 DEBUG [Listener at localhost/34517] regionserver.HRegion(2446): Flush status journal for d7273cd7ceac381f4e9d7eb10ecae3cd: 2023-11-13 04:54:57,094 INFO [Listener at localhost/34517] regionserver.HRegion(2745): Flushing d7273cd7ceac381f4e9d7eb10ecae3cd 1/1 column families, dataSize=37 B heapSize=368 B 2023-11-13 04:54:57,426 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-13 04:54:57,613 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x77d430c4 to 127.0.0.1:51072 2023-11-13 04:54:57,613 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-11-13 04:54:57,613 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-13 04:54:57,614 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-13 04:54:57,614 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x413bd812 to 127.0.0.1:51072 2023-11-13 04:54:57,614 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-13 04:54:57,614 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-13 04:54:57,614 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x454a5356 to 127.0.0.1:51072 2023-11-13 04:54:57,614 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-13 04:54:57,621 INFO [Listener at localhost/34517] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311138a39ae714b214108bd159eb2bc8a6f26 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311138a39ae714b214108bd159eb2bc8a6f26 2023-11-13 04:54:58,027 INFO [Listener at localhost/34517] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/.tmp/f1/a6dea6723ea74e2dac5593d64c6b0103 2023-11-13 04:54:58,032 DEBUG [Listener at localhost/34517] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/.tmp/f1/a6dea6723ea74e2dac5593d64c6b0103 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/a6dea6723ea74e2dac5593d64c6b0103 2023-11-13 04:54:58,036 INFO [Listener at localhost/34517] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/a6dea6723ea74e2dac5593d64c6b0103, entries=1, sequenceid=9, filesize=4.9 K 2023-11-13 04:54:58,037 INFO [Listener at localhost/34517] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for d7273cd7ceac381f4e9d7eb10ecae3cd in 943ms, sequenceid=9, compaction requested=false 2023-11-13 04:54:58,037 DEBUG [Listener at localhost/34517] regionserver.HRegion(2446): Flush status journal for d7273cd7ceac381f4e9d7eb10ecae3cd: 2023-11-13 04:54:58,039 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33831] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-11-13 04:54:58,040 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] procedure2.ProcedureExecutor(1028): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-13 04:54:58,041 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-13 04:54:58,041 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-13 04:54:58,041 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699851898041 2023-11-13 04:54:58,042 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-13 04:54:58,042 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-11-13 04:54:58,042 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-11-13 04:54:58,043 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] zookeeper.ReadOnlyZKClient(139): Connect 0x2941db19 to 127.0.0.1:51072 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-13 04:54:58,047 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@9f10c60, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-13 04:54:58,048 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231113 for table='testGetAfterCompaction' and column='f1' 2023-11-13 04:54:58,090 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/88a8bf21ae8345718016cfb9988b89a9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851297080; access_time=1699851296265; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:58,090 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/a6dea6723ea74e2dac5593d64c6b0103; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851298027; access_time=1699851297097; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:58,141 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/88a8bf21ae8345718016cfb9988b89a9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851297080; access_time=1699851296265; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:58,141 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/a6dea6723ea74e2dac5593d64c6b0103; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851298027; access_time=1699851297097; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:58,192 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/88a8bf21ae8345718016cfb9988b89a9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851297080; access_time=1699851296265; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:58,192 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/a6dea6723ea74e2dac5593d64c6b0103; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851298027; access_time=1699851297097; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:58,243 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/88a8bf21ae8345718016cfb9988b89a9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851297080; access_time=1699851296265; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:58,243 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/a6dea6723ea74e2dac5593d64c6b0103; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851298027; access_time=1699851297097; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:58,293 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/88a8bf21ae8345718016cfb9988b89a9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851297080; access_time=1699851296265; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:58,293 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/a6dea6723ea74e2dac5593d64c6b0103; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851298027; access_time=1699851297097; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:58,344 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/88a8bf21ae8345718016cfb9988b89a9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851297080; access_time=1699851296265; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:58,344 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/a6dea6723ea74e2dac5593d64c6b0103; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851298027; access_time=1699851297097; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:58,395 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/88a8bf21ae8345718016cfb9988b89a9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851297080; access_time=1699851296265; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:58,395 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/a6dea6723ea74e2dac5593d64c6b0103; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851298027; access_time=1699851297097; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:58,445 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/88a8bf21ae8345718016cfb9988b89a9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851297080; access_time=1699851296265; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:58,445 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/a6dea6723ea74e2dac5593d64c6b0103; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851298027; access_time=1699851297097; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:58,496 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/88a8bf21ae8345718016cfb9988b89a9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851297080; access_time=1699851296265; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:58,496 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/a6dea6723ea74e2dac5593d64c6b0103; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851298027; access_time=1699851297097; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:58,547 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/88a8bf21ae8345718016cfb9988b89a9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851297080; access_time=1699851296265; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:58,547 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/a6dea6723ea74e2dac5593d64c6b0103; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851298027; access_time=1699851297097; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:58,598 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/88a8bf21ae8345718016cfb9988b89a9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851297080; access_time=1699851296265; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:58,598 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/a6dea6723ea74e2dac5593d64c6b0103; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851298027; access_time=1699851297097; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:58,648 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/88a8bf21ae8345718016cfb9988b89a9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851297080; access_time=1699851296265; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:58,649 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/a6dea6723ea74e2dac5593d64c6b0103; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851298027; access_time=1699851297097; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:58,699 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/88a8bf21ae8345718016cfb9988b89a9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851297080; access_time=1699851296265; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:58,700 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/a6dea6723ea74e2dac5593d64c6b0103; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851298027; access_time=1699851297097; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:58,750 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/88a8bf21ae8345718016cfb9988b89a9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851297080; access_time=1699851296265; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:58,750 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/a6dea6723ea74e2dac5593d64c6b0103; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851298027; access_time=1699851297097; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:58,801 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/88a8bf21ae8345718016cfb9988b89a9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851297080; access_time=1699851296265; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:58,801 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/a6dea6723ea74e2dac5593d64c6b0103; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851298027; access_time=1699851297097; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:58,852 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/88a8bf21ae8345718016cfb9988b89a9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851297080; access_time=1699851296265; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:58,852 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/a6dea6723ea74e2dac5593d64c6b0103; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851298027; access_time=1699851297097; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:58,871 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311137b82bc70642a4281955664b97700bf8d to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311137b82bc70642a4281955664b97700bf8d 2023-11-13 04:54:58,872 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231113 table='testGetAfterCompaction' column='f1' 2023-11-13 04:54:58,889 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-13 04:54:58,890 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34130, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-13 04:54:58,896 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-13 04:54:58,898 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34490, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-13 04:54:58,902 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/88a8bf21ae8345718016cfb9988b89a9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851297080; access_time=1699851296265; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:58,902 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/a6dea6723ea74e2dac5593d64c6b0103; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851298027; access_time=1699851297097; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:58,905 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231113/f1/ff5c2d5b67e9427bbbe5a53f6dd3db4a first=Optional[r1] last=Optional[r2] 2023-11-13 04:54:58,906 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testGetAfterCompaction,,1699851294144.d7273cd7ceac381f4e9d7eb10ecae3cd., hostname=jenkins-hbase4.apache.org,41657,1699851201532, seqNum=2 for row with hfile group [{f1,hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231113/f1/ff5c2d5b67e9427bbbe5a53f6dd3db4a}] 2023-11-13 04:54:58,909 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(763): Validating hfile at hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231113/f1/ff5c2d5b67e9427bbbe5a53f6dd3db4a for inclusion in d7273cd7ceac381f4e9d7eb10ecae3cd/f1 2023-11-13 04:54:58,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-11-13 04:54:58,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(777): Region bounds: first= last= 2023-11-13 04:54:58,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HRegion(2446): Flush status journal for d7273cd7ceac381f4e9d7eb10ecae3cd: 2023-11-13 04:54:58,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231113/f1/ff5c2d5b67e9427bbbe5a53f6dd3db4a to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testGetAfterCompaction__b25v38crhl7okgmebpeiscdkll05s2bqqck8l31p3ntvgre5vod8fhcksbbtlco9/f1/ff5c2d5b67e9427bbbe5a53f6dd3db4a 2023-11-13 04:54:58,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testGetAfterCompaction__b25v38crhl7okgmebpeiscdkll05s2bqqck8l31p3ntvgre5vod8fhcksbbtlco9/f1/ff5c2d5b67e9427bbbe5a53f6dd3db4a as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/94b9e779f3644a24aaf1577618e9391a_SeqId_12_ 2023-11-13 04:54:58,914 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(849): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testGetAfterCompaction__b25v38crhl7okgmebpeiscdkll05s2bqqck8l31p3ntvgre5vod8fhcksbbtlco9/f1/ff5c2d5b67e9427bbbe5a53f6dd3db4a into d7273cd7ceac381f4e9d7eb10ecae3cd/f1 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/94b9e779f3644a24aaf1577618e9391a_SeqId_12_ - updating store file list. 2023-11-13 04:54:58,917 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(882): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/94b9e779f3644a24aaf1577618e9391a_SeqId_12_ into d7273cd7ceac381f4e9d7eb10ecae3cd/f1 2023-11-13 04:54:58,917 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(855): Successfully loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testGetAfterCompaction__b25v38crhl7okgmebpeiscdkll05s2bqqck8l31p3ntvgre5vod8fhcksbbtlco9/f1/ff5c2d5b67e9427bbbe5a53f6dd3db4a into d7273cd7ceac381f4e9d7eb10ecae3cd/f1 (new location: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/94b9e779f3644a24aaf1577618e9391a_SeqId_12_) 2023-11-13 04:54:58,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testGetAfterCompaction__b25v38crhl7okgmebpeiscdkll05s2bqqck8l31p3ntvgre5vod8fhcksbbtlco9/f1/ff5c2d5b67e9427bbbe5a53f6dd3db4a 2023-11-13 04:54:58,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(1912): d7273cd7ceac381f4e9d7eb10ecae3cd/f1 is initiating minor compaction 2023-11-13 04:54:58,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3e24e6db; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-13 04:54:58,918 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of d7273cd7ceac381f4e9d7eb10ecae3cd/f1 in testGetAfterCompaction,,1699851294144.d7273cd7ceac381f4e9d7eb10ecae3cd. 2023-11-13 04:54:58,918 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/a6dea6723ea74e2dac5593d64c6b0103, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/94b9e779f3644a24aaf1577618e9391a_SeqId_12_] into tmpdir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/.tmp, totalSize=10.0 K 2023-11-13 04:54:58,918 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting a6dea6723ea74e2dac5593d64c6b0103, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-13 04:54:58,918 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 94b9e779f3644a24aaf1577618e9391a_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-13 04:54:58,919 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231113 table='testGetAfterCompaction' column='f1' 2023-11-13 04:54:58,920 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:54:58,921 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311138a39ae714b214108bd159eb2bc8a6f26 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311138a39ae714b214108bd159eb2bc8a6f26 2023-11-13 04:54:58,922 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311139e483824a78942c69a48b6632da57c61 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311139e483824a78942c69a48b6632da57c61 2023-11-13 04:54:58,922 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-11-13 04:54:58,922 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231113' 2023-11-13 04:54:58,923 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231113 for table='testGetAfterCompaction' and column='f1' 2023-11-13 04:54:58,923 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-11-13 04:54:58,923 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-13 04:54:58,924 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-13 04:54:58,925 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] throttle.PressureAwareThroughputController(145): d7273cd7ceac381f4e9d7eb10ecae3cd#f1#compaction#76 average throughput is 0.13 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-13 04:54:58,925 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 885 msec 2023-11-13 04:54:58,953 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/88a8bf21ae8345718016cfb9988b89a9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851297080; access_time=1699851296265; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:58,953 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/94b9e779f3644a24aaf1577618e9391a_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699851298866; access_time=1699851298058; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-13 04:54:58,953 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/a6dea6723ea74e2dac5593d64c6b0103; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851298027; access_time=1699851297097; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:58,956 DEBUG [Listener at localhost/34517] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-13 04:54:58,959 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34142, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-13 04:54:58,959 INFO [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41657] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1699851294144.d7273cd7ceac381f4e9d7eb10ecae3cd. 2023-11-13 04:54:58,960 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41657] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-11-13 04:54:58,960 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41657] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-11-13 04:54:58,960 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41657] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-11-13 04:54:58,960 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41657] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1699851294144.d7273cd7ceac381f4e9d7eb10ecae3cd. because compaction request was cancelled 2023-11-13 04:54:59,011 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/88a8bf21ae8345718016cfb9988b89a9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851297080; access_time=1699851296265; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:59,012 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/94b9e779f3644a24aaf1577618e9391a_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699851298866; access_time=1699851298058; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-13 04:54:59,012 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/a6dea6723ea74e2dac5593d64c6b0103; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851298027; access_time=1699851297097; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:59,062 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/88a8bf21ae8345718016cfb9988b89a9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851297080; access_time=1699851296265; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:59,063 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/94b9e779f3644a24aaf1577618e9391a_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699851298866; access_time=1699851298058; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-13 04:54:59,063 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/a6dea6723ea74e2dac5593d64c6b0103; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851298027; access_time=1699851297097; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:59,113 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/88a8bf21ae8345718016cfb9988b89a9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851297080; access_time=1699851296265; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:59,113 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/94b9e779f3644a24aaf1577618e9391a_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699851298866; access_time=1699851298058; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-13 04:54:59,113 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/a6dea6723ea74e2dac5593d64c6b0103; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851298027; access_time=1699851297097; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:59,164 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/88a8bf21ae8345718016cfb9988b89a9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851297080; access_time=1699851296265; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:59,164 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/94b9e779f3644a24aaf1577618e9391a_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699851298866; access_time=1699851298058; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-13 04:54:59,164 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/a6dea6723ea74e2dac5593d64c6b0103; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851298027; access_time=1699851297097; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:59,215 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/88a8bf21ae8345718016cfb9988b89a9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851297080; access_time=1699851296265; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:59,215 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/94b9e779f3644a24aaf1577618e9391a_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699851298866; access_time=1699851298058; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-13 04:54:59,215 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/a6dea6723ea74e2dac5593d64c6b0103; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851298027; access_time=1699851297097; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:59,266 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/88a8bf21ae8345718016cfb9988b89a9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851297080; access_time=1699851296265; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:59,266 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/94b9e779f3644a24aaf1577618e9391a_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699851298866; access_time=1699851298058; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-13 04:54:59,266 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/a6dea6723ea74e2dac5593d64c6b0103; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851298027; access_time=1699851297097; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:59,317 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/88a8bf21ae8345718016cfb9988b89a9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851297080; access_time=1699851296265; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:59,317 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/94b9e779f3644a24aaf1577618e9391a_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699851298866; access_time=1699851298058; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-13 04:54:59,317 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/a6dea6723ea74e2dac5593d64c6b0103; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851298027; access_time=1699851297097; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:59,368 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/88a8bf21ae8345718016cfb9988b89a9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851297080; access_time=1699851296265; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:59,368 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/94b9e779f3644a24aaf1577618e9391a_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699851298866; access_time=1699851298058; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-13 04:54:59,368 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/a6dea6723ea74e2dac5593d64c6b0103; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851298027; access_time=1699851297097; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:59,419 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/88a8bf21ae8345718016cfb9988b89a9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851297080; access_time=1699851296265; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:59,419 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/94b9e779f3644a24aaf1577618e9391a_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699851298866; access_time=1699851298058; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-13 04:54:59,419 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/a6dea6723ea74e2dac5593d64c6b0103; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851298027; access_time=1699851297097; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:59,469 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/88a8bf21ae8345718016cfb9988b89a9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851297080; access_time=1699851296265; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:59,470 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/94b9e779f3644a24aaf1577618e9391a_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699851298866; access_time=1699851298058; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-13 04:54:59,470 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/a6dea6723ea74e2dac5593d64c6b0103; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851298027; access_time=1699851297097; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:59,520 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/88a8bf21ae8345718016cfb9988b89a9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851297080; access_time=1699851296265; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:59,521 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/94b9e779f3644a24aaf1577618e9391a_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699851298866; access_time=1699851298058; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-13 04:54:59,521 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/a6dea6723ea74e2dac5593d64c6b0103; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851298027; access_time=1699851297097; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:59,571 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/88a8bf21ae8345718016cfb9988b89a9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851297080; access_time=1699851296265; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:59,571 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/94b9e779f3644a24aaf1577618e9391a_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699851298866; access_time=1699851298058; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-13 04:54:59,572 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/a6dea6723ea74e2dac5593d64c6b0103; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851298027; access_time=1699851297097; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:59,622 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/88a8bf21ae8345718016cfb9988b89a9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851297080; access_time=1699851296265; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:59,622 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/94b9e779f3644a24aaf1577618e9391a_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699851298866; access_time=1699851298058; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-13 04:54:59,622 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/a6dea6723ea74e2dac5593d64c6b0103; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851298027; access_time=1699851297097; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:59,673 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/88a8bf21ae8345718016cfb9988b89a9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851297080; access_time=1699851296265; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:59,673 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/94b9e779f3644a24aaf1577618e9391a_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699851298866; access_time=1699851298058; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-13 04:54:59,673 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/a6dea6723ea74e2dac5593d64c6b0103; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851298027; access_time=1699851297097; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:59,724 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/88a8bf21ae8345718016cfb9988b89a9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851297080; access_time=1699851296265; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:59,724 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/94b9e779f3644a24aaf1577618e9391a_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699851298866; access_time=1699851298058; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-13 04:54:59,724 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/a6dea6723ea74e2dac5593d64c6b0103; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851298027; access_time=1699851297097; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:59,739 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/.tmp/f1/776415ab797948ceaeb9e47c871b023a as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/776415ab797948ceaeb9e47c871b023a 2023-11-13 04:54:59,743 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in d7273cd7ceac381f4e9d7eb10ecae3cd/f1 of d7273cd7ceac381f4e9d7eb10ecae3cd into 776415ab797948ceaeb9e47c871b023a(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-13 04:54:59,743 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for d7273cd7ceac381f4e9d7eb10ecae3cd: 2023-11-13 04:54:59,743 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1699851294144.d7273cd7ceac381f4e9d7eb10ecae3cd., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1699851298917; duration=0sec 2023-11-13 04:54:59,743 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-13 04:54:59,775 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/776415ab797948ceaeb9e47c871b023a; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1699851299733; access_time=1699851298922; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:59,775 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/88a8bf21ae8345718016cfb9988b89a9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851297080; access_time=1699851296265; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:59,775 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/94b9e779f3644a24aaf1577618e9391a_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699851298866; access_time=1699851298058; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-13 04:54:59,775 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/a6dea6723ea74e2dac5593d64c6b0103; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851298027; access_time=1699851297097; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:59,815 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/a6dea6723ea74e2dac5593d64c6b0103, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/94b9e779f3644a24aaf1577618e9391a_SeqId_12_] to archive 2023-11-13 04:54:59,816 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:54:59,818 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/a6dea6723ea74e2dac5593d64c6b0103 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/a6dea6723ea74e2dac5593d64c6b0103 2023-11-13 04:54:59,819 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/94b9e779f3644a24aaf1577618e9391a_SeqId_12_ to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/94b9e779f3644a24aaf1577618e9391a_SeqId_12_ 2023-11-13 04:54:59,825 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/776415ab797948ceaeb9e47c871b023a; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1699851299733; access_time=1699851298922; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:59,826 INFO [Listener at localhost/34517] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/88a8bf21ae8345718016cfb9988b89a9; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699851297080; access_time=1699851296265; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-13 04:54:59,944 INFO [Listener at localhost/34517] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-11-13 04:54:59,949 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testGetAfterCompaction 2023-11-13 04:54:59,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure2.ProcedureExecutor(1028): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-11-13 04:54:59,958 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699851299958"}]},"ts":"1699851299958"} 2023-11-13 04:54:59,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-13 04:54:59,959 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-11-13 04:54:59,961 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-11-13 04:54:59,963 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=d7273cd7ceac381f4e9d7eb10ecae3cd, UNASSIGN}] 2023-11-13 04:54:59,964 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=d7273cd7ceac381f4e9d7eb10ecae3cd, UNASSIGN 2023-11-13 04:54:59,964 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=d7273cd7ceac381f4e9d7eb10ecae3cd, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:54:59,964 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1699851294144.d7273cd7ceac381f4e9d7eb10ecae3cd.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1699851299964"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699851299964"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699851299964"}]},"ts":"1699851299964"} 2023-11-13 04:54:59,965 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure d7273cd7ceac381f4e9d7eb10ecae3cd, server=jenkins-hbase4.apache.org,41657,1699851201532}] 2023-11-13 04:55:00,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-13 04:55:00,117 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:00,117 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d7273cd7ceac381f4e9d7eb10ecae3cd 2023-11-13 04:55:00,117 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d7273cd7ceac381f4e9d7eb10ecae3cd, disabling compactions & flushes 2023-11-13 04:55:00,117 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1699851294144.d7273cd7ceac381f4e9d7eb10ecae3cd. 2023-11-13 04:55:00,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1699851294144.d7273cd7ceac381f4e9d7eb10ecae3cd. 2023-11-13 04:55:00,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1699851294144.d7273cd7ceac381f4e9d7eb10ecae3cd. after waiting 0 ms 2023-11-13 04:55:00,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1699851294144.d7273cd7ceac381f4e9d7eb10ecae3cd. 2023-11-13 04:55:00,123 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-11-13 04:55:00,124 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-11-13 04:55:00,125 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1699851294144.d7273cd7ceac381f4e9d7eb10ecae3cd. 2023-11-13 04:55:00,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d7273cd7ceac381f4e9d7eb10ecae3cd: 2023-11-13 04:55:00,126 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d7273cd7ceac381f4e9d7eb10ecae3cd 2023-11-13 04:55:00,127 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=d7273cd7ceac381f4e9d7eb10ecae3cd, regionState=CLOSED 2023-11-13 04:55:00,127 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1699851294144.d7273cd7ceac381f4e9d7eb10ecae3cd.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1699851300127"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699851300127"}]},"ts":"1699851300127"} 2023-11-13 04:55:00,129 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-11-13 04:55:00,129 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure d7273cd7ceac381f4e9d7eb10ecae3cd, server=jenkins-hbase4.apache.org,41657,1699851201532 in 163 msec 2023-11-13 04:55:00,130 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=75 2023-11-13 04:55:00,130 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=d7273cd7ceac381f4e9d7eb10ecae3cd, UNASSIGN in 167 msec 2023-11-13 04:55:00,130 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699851300130"}]},"ts":"1699851300130"} 2023-11-13 04:55:00,131 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-11-13 04:55:00,133 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-11-13 04:55:00,134 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 182 msec 2023-11-13 04:55:00,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-13 04:55:00,261 INFO [Listener at localhost/34517] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-11-13 04:55:00,265 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testGetAfterCompaction 2023-11-13 04:55:00,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-11-13 04:55:00,273 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-13 04:55:00,274 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-13 04:55:00,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-11-13 04:55:00,277 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd 2023-11-13 04:55:00,279 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1, FileablePath, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/recovered.edits] 2023-11-13 04:55:00,282 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/776415ab797948ceaeb9e47c871b023a to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/776415ab797948ceaeb9e47c871b023a 2023-11-13 04:55:00,283 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/88a8bf21ae8345718016cfb9988b89a9 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/f1/88a8bf21ae8345718016cfb9988b89a9 2023-11-13 04:55:00,285 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/recovered.edits/15.seqid to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd/recovered.edits/15.seqid 2023-11-13 04:55:00,286 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testGetAfterCompaction/d7273cd7ceac381f4e9d7eb10ecae3cd 2023-11-13 04:55:00,286 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-11-13 04:55:00,286 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-11-13 04:55:00,287 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-11-13 04:55:00,290 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311137b82bc70642a4281955664b97700bf8d to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311137b82bc70642a4281955664b97700bf8d 2023-11-13 04:55:00,290 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-11-13 04:55:00,292 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-13 04:55:00,313 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-11-13 04:55:00,315 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-11-13 04:55:00,316 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-13 04:55:00,316 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-11-13 04:55:00,316 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1699851294144.d7273cd7ceac381f4e9d7eb10ecae3cd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1699851300316"}]},"ts":"9223372036854775807"} 2023-11-13 04:55:00,318 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-11-13 04:55:00,318 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d7273cd7ceac381f4e9d7eb10ecae3cd, NAME => 'testGetAfterCompaction,,1699851294144.d7273cd7ceac381f4e9d7eb10ecae3cd.', STARTKEY => '', ENDKEY => ''}] 2023-11-13 04:55:00,318 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-11-13 04:55:00,318 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1699851300318"}]},"ts":"9223372036854775807"} 2023-11-13 04:55:00,319 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-11-13 04:55:00,321 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-13 04:55:00,322 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 55 msec 2023-11-13 04:55:00,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-11-13 04:55:00,376 INFO [Listener at localhost/34517] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-11-13 04:55:00,388 INFO [Listener at localhost/34517] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=238 (was 243), OpenFileDescriptor=619 (was 653), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=136 (was 87) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 169), AvailableMemoryMB=2412 (was 2477) 2023-11-13 04:55:00,398 INFO [Listener at localhost/34517] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=238, OpenFileDescriptor=619, MaxFileDescriptor=60000, SystemLoadAverage=136, ProcessCount=167, AvailableMemoryMB=2411 2023-11-13 04:55:00,400 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-13 04:55:00,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-11-13 04:55:00,402 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-11-13 04:55:00,402 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-11-13 04:55:00,403 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-13 04:55:00,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-13 04:55:00,405 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8 2023-11-13 04:55:00,405 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a 2023-11-13 04:55:00,405 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7 2023-11-13 04:55:00,405 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8 empty. 2023-11-13 04:55:00,405 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7 empty. 2023-11-13 04:55:00,405 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a empty. 2023-11-13 04:55:00,406 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8 2023-11-13 04:55:00,406 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a 2023-11-13 04:55:00,406 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7 2023-11-13 04:55:00,406 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-11-13 04:55:00,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-13 04:55:00,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-13 04:55:00,814 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-11-13 04:55:00,816 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7675): creating {ENCODED => 6638aa08a24bc6e34e9840c49e638c8a, NAME => 'testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp 2023-11-13 04:55:00,816 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7675): creating {ENCODED => e13efa47a2338bfc8c25006e697a36d8, NAME => 'testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp 2023-11-13 04:55:00,816 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7675): creating {ENCODED => bfeed2e88ce202cf921374d6d67968c7, NAME => 'testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp 2023-11-13 04:55:00,829 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-13 04:55:00,829 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1604): Closing 6638aa08a24bc6e34e9840c49e638c8a, disabling compactions & flushes 2023-11-13 04:55:00,829 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a. 2023-11-13 04:55:00,829 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a. 2023-11-13 04:55:00,829 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a. after waiting 0 ms 2023-11-13 04:55:00,829 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a. 2023-11-13 04:55:00,829 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a. 2023-11-13 04:55:00,829 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1558): Region close journal for 6638aa08a24bc6e34e9840c49e638c8a: 2023-11-13 04:55:00,831 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-13 04:55:00,831 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1604): Closing e13efa47a2338bfc8c25006e697a36d8, disabling compactions & flushes 2023-11-13 04:55:00,831 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8. 2023-11-13 04:55:00,831 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8. 2023-11-13 04:55:00,831 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8. after waiting 0 ms 2023-11-13 04:55:00,831 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8. 2023-11-13 04:55:00,831 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8. 2023-11-13 04:55:00,831 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1558): Region close journal for e13efa47a2338bfc8c25006e697a36d8: 2023-11-13 04:55:01,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-13 04:55:01,226 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-13 04:55:01,226 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1604): Closing bfeed2e88ce202cf921374d6d67968c7, disabling compactions & flushes 2023-11-13 04:55:01,226 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7. 2023-11-13 04:55:01,226 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7. 2023-11-13 04:55:01,226 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7. after waiting 0 ms 2023-11-13 04:55:01,226 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7. 2023-11-13 04:55:01,226 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7. 2023-11-13 04:55:01,226 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1558): Region close journal for bfeed2e88ce202cf921374d6d67968c7: 2023-11-13 04:55:01,229 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-11-13 04:55:01,230 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699851301230"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699851301230"}]},"ts":"1699851301230"} 2023-11-13 04:55:01,230 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699851301230"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699851301230"}]},"ts":"1699851301230"} 2023-11-13 04:55:01,230 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699851301230"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699851301230"}]},"ts":"1699851301230"} 2023-11-13 04:55:01,233 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-13 04:55:01,234 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-13 04:55:01,234 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699851301234"}]},"ts":"1699851301234"} 2023-11-13 04:55:01,235 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-11-13 04:55:01,241 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=e13efa47a2338bfc8c25006e697a36d8, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=6638aa08a24bc6e34e9840c49e638c8a, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=bfeed2e88ce202cf921374d6d67968c7, ASSIGN}] 2023-11-13 04:55:01,242 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=bfeed2e88ce202cf921374d6d67968c7, ASSIGN 2023-11-13 04:55:01,242 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=e13efa47a2338bfc8c25006e697a36d8, ASSIGN 2023-11-13 04:55:01,242 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=6638aa08a24bc6e34e9840c49e638c8a, ASSIGN 2023-11-13 04:55:01,243 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=bfeed2e88ce202cf921374d6d67968c7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41657,1699851201532; forceNewPlan=false, retain=false 2023-11-13 04:55:01,243 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=6638aa08a24bc6e34e9840c49e638c8a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41657,1699851201532; forceNewPlan=false, retain=false 2023-11-13 04:55:01,243 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=e13efa47a2338bfc8c25006e697a36d8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41657,1699851201532; forceNewPlan=false, retain=false 2023-11-13 04:55:01,395 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=6638aa08a24bc6e34e9840c49e638c8a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:01,395 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=e13efa47a2338bfc8c25006e697a36d8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:01,395 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=bfeed2e88ce202cf921374d6d67968c7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:01,395 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699851301395"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699851301395"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699851301395"}]},"ts":"1699851301395"} 2023-11-13 04:55:01,395 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699851301395"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699851301395"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699851301395"}]},"ts":"1699851301395"} 2023-11-13 04:55:01,395 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699851301395"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699851301395"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699851301395"}]},"ts":"1699851301395"} 2023-11-13 04:55:01,397 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=83, ppid=81, state=RUNNABLE; OpenRegionProcedure 6638aa08a24bc6e34e9840c49e638c8a, server=jenkins-hbase4.apache.org,41657,1699851201532}] 2023-11-13 04:55:01,397 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=84, ppid=82, state=RUNNABLE; OpenRegionProcedure bfeed2e88ce202cf921374d6d67968c7, server=jenkins-hbase4.apache.org,41657,1699851201532}] 2023-11-13 04:55:01,400 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=80, state=RUNNABLE; OpenRegionProcedure e13efa47a2338bfc8c25006e697a36d8, server=jenkins-hbase4.apache.org,41657,1699851201532}] 2023-11-13 04:55:01,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-13 04:55:01,550 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:01,553 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a. 2023-11-13 04:55:01,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6638aa08a24bc6e34e9840c49e638c8a, NAME => 'testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a.', STARTKEY => '1', ENDKEY => '2'} 2023-11-13 04:55:01,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 6638aa08a24bc6e34e9840c49e638c8a 2023-11-13 04:55:01,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-13 04:55:01,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6638aa08a24bc6e34e9840c49e638c8a 2023-11-13 04:55:01,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6638aa08a24bc6e34e9840c49e638c8a 2023-11-13 04:55:01,555 INFO [StoreOpener-6638aa08a24bc6e34e9840c49e638c8a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 6638aa08a24bc6e34e9840c49e638c8a 2023-11-13 04:55:01,556 DEBUG [StoreOpener-6638aa08a24bc6e34e9840c49e638c8a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1 2023-11-13 04:55:01,557 DEBUG [StoreOpener-6638aa08a24bc6e34e9840c49e638c8a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1 2023-11-13 04:55:01,557 INFO [StoreOpener-6638aa08a24bc6e34e9840c49e638c8a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6638aa08a24bc6e34e9840c49e638c8a columnFamilyName family1 2023-11-13 04:55:01,558 INFO [StoreOpener-6638aa08a24bc6e34e9840c49e638c8a-1] regionserver.HStore(310): Store=6638aa08a24bc6e34e9840c49e638c8a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-13 04:55:01,559 INFO [StoreOpener-6638aa08a24bc6e34e9840c49e638c8a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 6638aa08a24bc6e34e9840c49e638c8a 2023-11-13 04:55:01,560 DEBUG [StoreOpener-6638aa08a24bc6e34e9840c49e638c8a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2 2023-11-13 04:55:01,560 DEBUG [StoreOpener-6638aa08a24bc6e34e9840c49e638c8a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2 2023-11-13 04:55:01,560 INFO [StoreOpener-6638aa08a24bc6e34e9840c49e638c8a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6638aa08a24bc6e34e9840c49e638c8a columnFamilyName family2 2023-11-13 04:55:01,562 INFO [StoreOpener-6638aa08a24bc6e34e9840c49e638c8a-1] regionserver.HStore(310): Store=6638aa08a24bc6e34e9840c49e638c8a/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-13 04:55:01,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a 2023-11-13 04:55:01,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a 2023-11-13 04:55:01,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-13 04:55:01,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6638aa08a24bc6e34e9840c49e638c8a 2023-11-13 04:55:01,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-13 04:55:01,568 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6638aa08a24bc6e34e9840c49e638c8a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65982445, jitterRate=-0.016784951090812683}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-13 04:55:01,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6638aa08a24bc6e34e9840c49e638c8a: 2023-11-13 04:55:01,569 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a., pid=83, masterSystemTime=1699851301550 2023-11-13 04:55:01,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a. 2023-11-13 04:55:01,570 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a. 2023-11-13 04:55:01,571 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8. 2023-11-13 04:55:01,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e13efa47a2338bfc8c25006e697a36d8, NAME => 'testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8.', STARTKEY => '', ENDKEY => '1'} 2023-11-13 04:55:01,571 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=6638aa08a24bc6e34e9840c49e638c8a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:01,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink e13efa47a2338bfc8c25006e697a36d8 2023-11-13 04:55:01,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-13 04:55:01,571 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699851301571"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699851301571"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699851301571"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699851301571"}]},"ts":"1699851301571"} 2023-11-13 04:55:01,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e13efa47a2338bfc8c25006e697a36d8 2023-11-13 04:55:01,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e13efa47a2338bfc8c25006e697a36d8 2023-11-13 04:55:01,572 INFO [StoreOpener-e13efa47a2338bfc8c25006e697a36d8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e13efa47a2338bfc8c25006e697a36d8 2023-11-13 04:55:01,574 DEBUG [StoreOpener-e13efa47a2338bfc8c25006e697a36d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1 2023-11-13 04:55:01,574 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=83, resume processing ppid=81 2023-11-13 04:55:01,574 DEBUG [StoreOpener-e13efa47a2338bfc8c25006e697a36d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1 2023-11-13 04:55:01,574 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=83, ppid=81, state=SUCCESS; OpenRegionProcedure 6638aa08a24bc6e34e9840c49e638c8a, server=jenkins-hbase4.apache.org,41657,1699851201532 in 175 msec 2023-11-13 04:55:01,574 INFO [StoreOpener-e13efa47a2338bfc8c25006e697a36d8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e13efa47a2338bfc8c25006e697a36d8 columnFamilyName family1 2023-11-13 04:55:01,575 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=6638aa08a24bc6e34e9840c49e638c8a, ASSIGN in 334 msec 2023-11-13 04:55:01,575 INFO [StoreOpener-e13efa47a2338bfc8c25006e697a36d8-1] regionserver.HStore(310): Store=e13efa47a2338bfc8c25006e697a36d8/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-13 04:55:01,576 INFO [StoreOpener-e13efa47a2338bfc8c25006e697a36d8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region e13efa47a2338bfc8c25006e697a36d8 2023-11-13 04:55:01,577 DEBUG [StoreOpener-e13efa47a2338bfc8c25006e697a36d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2 2023-11-13 04:55:01,577 DEBUG [StoreOpener-e13efa47a2338bfc8c25006e697a36d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2 2023-11-13 04:55:01,577 INFO [StoreOpener-e13efa47a2338bfc8c25006e697a36d8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e13efa47a2338bfc8c25006e697a36d8 columnFamilyName family2 2023-11-13 04:55:01,578 INFO [StoreOpener-e13efa47a2338bfc8c25006e697a36d8-1] regionserver.HStore(310): Store=e13efa47a2338bfc8c25006e697a36d8/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-13 04:55:01,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8 2023-11-13 04:55:01,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8 2023-11-13 04:55:01,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-13 04:55:01,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e13efa47a2338bfc8c25006e697a36d8 2023-11-13 04:55:01,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-13 04:55:01,584 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e13efa47a2338bfc8c25006e697a36d8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70250108, jitterRate=0.04680818319320679}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-13 04:55:01,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e13efa47a2338bfc8c25006e697a36d8: 2023-11-13 04:55:01,584 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8., pid=85, masterSystemTime=1699851301550 2023-11-13 04:55:01,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8. 2023-11-13 04:55:01,585 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8. 2023-11-13 04:55:01,585 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7. 2023-11-13 04:55:01,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bfeed2e88ce202cf921374d6d67968c7, NAME => 'testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7.', STARTKEY => '2', ENDKEY => ''} 2023-11-13 04:55:01,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink bfeed2e88ce202cf921374d6d67968c7 2023-11-13 04:55:01,586 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=e13efa47a2338bfc8c25006e697a36d8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:01,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-13 04:55:01,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bfeed2e88ce202cf921374d6d67968c7 2023-11-13 04:55:01,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bfeed2e88ce202cf921374d6d67968c7 2023-11-13 04:55:01,586 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699851301585"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699851301585"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699851301585"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699851301585"}]},"ts":"1699851301585"} 2023-11-13 04:55:01,587 INFO [StoreOpener-bfeed2e88ce202cf921374d6d67968c7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region bfeed2e88ce202cf921374d6d67968c7 2023-11-13 04:55:01,588 DEBUG [StoreOpener-bfeed2e88ce202cf921374d6d67968c7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1 2023-11-13 04:55:01,588 DEBUG [StoreOpener-bfeed2e88ce202cf921374d6d67968c7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1 2023-11-13 04:55:01,588 INFO [StoreOpener-bfeed2e88ce202cf921374d6d67968c7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bfeed2e88ce202cf921374d6d67968c7 columnFamilyName family1 2023-11-13 04:55:01,588 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=85, resume processing ppid=80 2023-11-13 04:55:01,588 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=80, state=SUCCESS; OpenRegionProcedure e13efa47a2338bfc8c25006e697a36d8, server=jenkins-hbase4.apache.org,41657,1699851201532 in 189 msec 2023-11-13 04:55:01,589 INFO [StoreOpener-bfeed2e88ce202cf921374d6d67968c7-1] regionserver.HStore(310): Store=bfeed2e88ce202cf921374d6d67968c7/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-13 04:55:01,589 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=e13efa47a2338bfc8c25006e697a36d8, ASSIGN in 348 msec 2023-11-13 04:55:01,590 INFO [StoreOpener-bfeed2e88ce202cf921374d6d67968c7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region bfeed2e88ce202cf921374d6d67968c7 2023-11-13 04:55:01,591 DEBUG [StoreOpener-bfeed2e88ce202cf921374d6d67968c7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2 2023-11-13 04:55:01,591 DEBUG [StoreOpener-bfeed2e88ce202cf921374d6d67968c7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2 2023-11-13 04:55:01,591 INFO [StoreOpener-bfeed2e88ce202cf921374d6d67968c7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bfeed2e88ce202cf921374d6d67968c7 columnFamilyName family2 2023-11-13 04:55:01,592 INFO [StoreOpener-bfeed2e88ce202cf921374d6d67968c7-1] regionserver.HStore(310): Store=bfeed2e88ce202cf921374d6d67968c7/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-13 04:55:01,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7 2023-11-13 04:55:01,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7 2023-11-13 04:55:01,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-13 04:55:01,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bfeed2e88ce202cf921374d6d67968c7 2023-11-13 04:55:01,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-13 04:55:01,597 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bfeed2e88ce202cf921374d6d67968c7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73754336, jitterRate=0.09902524948120117}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-13 04:55:01,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bfeed2e88ce202cf921374d6d67968c7: 2023-11-13 04:55:01,598 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7., pid=84, masterSystemTime=1699851301550 2023-11-13 04:55:01,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7. 2023-11-13 04:55:01,599 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7. 2023-11-13 04:55:01,599 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=bfeed2e88ce202cf921374d6d67968c7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:01,600 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699851301599"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699851301599"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699851301599"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699851301599"}]},"ts":"1699851301599"} 2023-11-13 04:55:01,602 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=84, resume processing ppid=82 2023-11-13 04:55:01,602 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=84, ppid=82, state=SUCCESS; OpenRegionProcedure bfeed2e88ce202cf921374d6d67968c7, server=jenkins-hbase4.apache.org,41657,1699851201532 in 204 msec 2023-11-13 04:55:01,604 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=79 2023-11-13 04:55:01,604 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=bfeed2e88ce202cf921374d6d67968c7, ASSIGN in 361 msec 2023-11-13 04:55:01,604 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-13 04:55:01,604 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699851301604"}]},"ts":"1699851301604"} 2023-11-13 04:55:01,605 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-11-13 04:55:01,608 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-11-13 04:55:01,609 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 1.2080 sec 2023-11-13 04:55:02,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-13 04:55:02,507 INFO [Listener at localhost/34517] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-11-13 04:55:02,514 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8. with WAL disabled. Data may be lost in the event of a crash. 2023-11-13 04:55:02,515 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a. with WAL disabled. Data may be lost in the event of a crash. 2023-11-13 04:55:02,516 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7. with WAL disabled. Data may be lost in the event of a crash. 2023-11-13 04:55:02,519 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:55:02,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-13 04:55:02,520 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-13 04:55:02,520 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:55:02,520 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-13 04:55:02,520 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-13 04:55:02,521 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-13 04:55:02,521 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-13 04:55:02,522 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:55:02,522 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:02,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:55:02,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:55:02,522 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:02,523 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:55:02,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-13 04:55:02,523 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-13 04:55:02,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:55:02,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-13 04:55:02,523 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-13 04:55:02,523 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-13 04:55:02,524 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-13 04:55:02,524 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:55:02,524 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-13 04:55:02,524 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a. 2023-11-13 04:55:02,524 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a. started... 2023-11-13 04:55:02,524 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-13 04:55:02,524 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:55:02,524 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7. 2023-11-13 04:55:02,525 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6638aa08a24bc6e34e9840c49e638c8a 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-13 04:55:02,525 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7. started... 2023-11-13 04:55:02,525 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8. 2023-11-13 04:55:02,525 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8. started... 2023-11-13 04:55:02,525 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing bfeed2e88ce202cf921374d6d67968c7 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-13 04:55:02,526 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing e13efa47a2338bfc8c25006e697a36d8 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-13 04:55:02,538 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231113f6671f6d9d62429f971e5c2dd1292622 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231113f6671f6d9d62429f971e5c2dd1292622 2023-11-13 04:55:02,540 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231113a01b6cba5f564864bf45c965c8cd4871 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231113a01b6cba5f564864bf45c965c8cd4871 2023-11-13 04:55:02,543 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/.tmp/family1/fccd59c304254894860a914ea6db14f2 2023-11-13 04:55:02,544 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/.tmp/family1/12c93e792bf84957ac292148d77afa10 2023-11-13 04:55:02,560 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231113e8e4613a8a8f4269bee5ece2df9b6412 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231113e8e4613a8a8f4269bee5ece2df9b6412 2023-11-13 04:55:02,564 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/.tmp/family2/86886665116d4ba293a13c09aedad26a 2023-11-13 04:55:02,568 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/.tmp/family1/12c93e792bf84957ac292148d77afa10 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/12c93e792bf84957ac292148d77afa10 2023-11-13 04:55:02,571 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/12c93e792bf84957ac292148d77afa10, entries=4, sequenceid=5, filesize=5.4 K 2023-11-13 04:55:02,571 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/.tmp/family2/86886665116d4ba293a13c09aedad26a as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/86886665116d4ba293a13c09aedad26a 2023-11-13 04:55:02,574 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/86886665116d4ba293a13c09aedad26a, entries=2, sequenceid=5, filesize=5.1 K 2023-11-13 04:55:02,575 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 6638aa08a24bc6e34e9840c49e638c8a in 50ms, sequenceid=5, compaction requested=false 2023-11-13 04:55:02,575 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-11-13 04:55:02,575 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6638aa08a24bc6e34e9840c49e638c8a: 2023-11-13 04:55:02,575 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a. 2023-11-13 04:55:02,575 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-13 04:55:02,940 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111382d6195e776e49da80fb040337f6e2f1 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023111382d6195e776e49da80fb040337f6e2f1 2023-11-13 04:55:02,960 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231113939643500d7b477fad4541b401fc96a8 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231113939643500d7b477fad4541b401fc96a8 2023-11-13 04:55:02,966 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/.tmp/family2/8f39ca4d1f2047799898b9eb81767fb1 2023-11-13 04:55:02,970 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/.tmp/family1/fccd59c304254894860a914ea6db14f2 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/fccd59c304254894860a914ea6db14f2 2023-11-13 04:55:02,975 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/fccd59c304254894860a914ea6db14f2, entries=4, sequenceid=5, filesize=5.4 K 2023-11-13 04:55:02,975 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/.tmp/family2/8f39ca4d1f2047799898b9eb81767fb1 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/8f39ca4d1f2047799898b9eb81767fb1 2023-11-13 04:55:02,980 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/8f39ca4d1f2047799898b9eb81767fb1, entries=2, sequenceid=5, filesize=5.1 K 2023-11-13 04:55:02,982 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for bfeed2e88ce202cf921374d6d67968c7 in 457ms, sequenceid=5, compaction requested=false 2023-11-13 04:55:02,983 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for bfeed2e88ce202cf921374d6d67968c7: 2023-11-13 04:55:02,983 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7. 2023-11-13 04:55:02,983 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-13 04:55:03,345 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/.tmp/family1/390824bbfce04fd9ac1b935a17760523 2023-11-13 04:55:03,759 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111390eeffa2d10541da821f54f8dd3aa9e0 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111390eeffa2d10541da821f54f8dd3aa9e0 2023-11-13 04:55:04,164 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/.tmp/family2/425709ac686d4a6599e4146cbc4e1457 2023-11-13 04:55:04,168 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/.tmp/family1/390824bbfce04fd9ac1b935a17760523 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/390824bbfce04fd9ac1b935a17760523 2023-11-13 04:55:04,171 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/390824bbfce04fd9ac1b935a17760523, entries=4, sequenceid=5, filesize=5.4 K 2023-11-13 04:55:04,172 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/.tmp/family2/425709ac686d4a6599e4146cbc4e1457 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/425709ac686d4a6599e4146cbc4e1457 2023-11-13 04:55:04,175 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/425709ac686d4a6599e4146cbc4e1457, entries=2, sequenceid=5, filesize=5.1 K 2023-11-13 04:55:04,176 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for e13efa47a2338bfc8c25006e697a36d8 in 1650ms, sequenceid=5, compaction requested=false 2023-11-13 04:55:04,176 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for e13efa47a2338bfc8c25006e697a36d8: 2023-11-13 04:55:04,176 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8. 2023-11-13 04:55:04,176 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-13 04:55:04,176 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-13 04:55:04,176 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:04,176 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-13 04:55:04,176 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-13 04:55:04,178 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-13 04:55:04,178 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:04,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:04,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:04,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:04,178 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-13 04:55:04,178 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:55:04,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:04,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:04,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-13 04:55:04,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:04,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:04,180 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-13 04:55:04,180 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c4eede[Count = 0] remaining members to acquire global barrier 2023-11-13 04:55:04,180 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-13 04:55:04,180 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-13 04:55:04,181 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-13 04:55:04,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-13 04:55:04,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-13 04:55:04,181 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-13 04:55:04,181 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-13 04:55:04,181 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:55:04,182 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:04,182 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:55:04,183 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-13 04:55:04,183 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:55:04,183 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:04,183 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-13 04:55:04,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:04,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:04,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:04,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:04,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:04,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-13 04:55:04,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:04,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:04,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-13 04:55:04,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:04,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:55:04,185 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-13 04:55:04,185 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-13 04:55:04,185 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:55:04,185 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:55:04,185 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-13 04:55:04,185 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:55:04,188 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-13 04:55:04,188 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-13 04:55:04,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-13 04:55:04,188 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:55:04,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-13 04:55:04,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-13 04:55:04,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:04,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:04,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:55:04,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:55:04,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:04,188 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:04,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-13 04:55:04,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-13 04:55:04,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:04,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-13 04:55:04,189 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:04,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:04,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:04,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-13 04:55:04,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:04,192 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:04,192 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-13 04:55:04,192 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:55:04,192 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-13 04:55:04,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:55:04,192 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:55:04,192 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-13 04:55:04,192 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:55:04,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:55:04,192 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:04,192 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:55:04,192 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-13 04:55:04,192 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-13 04:55:04,192 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-13 04:55:04,192 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-13 04:55:04,192 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-13 04:55:04,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:55:04,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:55:04,192 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:55:04,292 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:55:04,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:55:04,294 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8. with WAL disabled. Data may be lost in the event of a crash. 2023-11-13 04:55:04,294 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a. with WAL disabled. Data may be lost in the event of a crash. 2023-11-13 04:55:04,295 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7. with WAL disabled. Data may be lost in the event of a crash. 2023-11-13 04:55:04,297 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:55:04,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-13 04:55:04,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-13 04:55:04,299 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-13 04:55:04,299 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:55:04,299 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-13 04:55:04,299 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-13 04:55:04,300 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-13 04:55:04,300 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-13 04:55:04,301 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:55:04,301 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:04,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:55:04,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:55:04,302 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:04,302 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:55:04,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-13 04:55:04,302 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-13 04:55:04,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:55:04,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-13 04:55:04,303 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-13 04:55:04,303 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-13 04:55:04,303 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-13 04:55:04,303 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-13 04:55:04,303 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:55:04,303 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-13 04:55:04,304 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a. 2023-11-13 04:55:04,304 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a. started... 2023-11-13 04:55:04,304 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6638aa08a24bc6e34e9840c49e638c8a 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-13 04:55:04,304 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7. 2023-11-13 04:55:04,304 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-13 04:55:04,304 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:55:04,304 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7. started... 2023-11-13 04:55:04,304 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8. 2023-11-13 04:55:04,305 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8. started... 2023-11-13 04:55:04,305 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing bfeed2e88ce202cf921374d6d67968c7 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-13 04:55:04,305 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing e13efa47a2338bfc8c25006e697a36d8 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-13 04:55:04,735 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023111343a962cdb9454855b1cba6892085e038 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023111343a962cdb9454855b1cba6892085e038 2023-11-13 04:55:04,735 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111378016b094e234a4386415dae4a14c642 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023111378016b094e234a4386415dae4a14c642 2023-11-13 04:55:04,735 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231113a253e2457d5f435ebee6f1ee36f55d25 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231113a253e2457d5f435ebee6f1ee36f55d25 2023-11-13 04:55:05,144 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/.tmp/family1/4a4345fbfaf544a4bca8220aa5491d91 2023-11-13 04:55:05,148 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/.tmp/family1/c5987b1cd73845f98c8edc455ccf47dc 2023-11-13 04:55:05,148 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/.tmp/family1/2ea41d0a5fc141e4ad3d775a051b52a4 2023-11-13 04:55:05,560 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231113071d0287206243239789636b4dc85b96 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231113071d0287206243239789636b4dc85b96 2023-11-13 04:55:05,564 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111346efaa5f2574453c9dbabc830b5d3db4 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111346efaa5f2574453c9dbabc830b5d3db4 2023-11-13 04:55:05,565 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111351e97193a3d546a7a8b08e3a25a5f470 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023111351e97193a3d546a7a8b08e3a25a5f470 2023-11-13 04:55:05,566 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/.tmp/family2/3a385363c38c493db398a3eeb8c23c45 2023-11-13 04:55:05,570 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/.tmp/family1/4a4345fbfaf544a4bca8220aa5491d91 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/4a4345fbfaf544a4bca8220aa5491d91 2023-11-13 04:55:05,574 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/4a4345fbfaf544a4bca8220aa5491d91, entries=4, sequenceid=9, filesize=5.4 K 2023-11-13 04:55:05,575 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/.tmp/family2/3a385363c38c493db398a3eeb8c23c45 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/3a385363c38c493db398a3eeb8c23c45 2023-11-13 04:55:05,578 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/3a385363c38c493db398a3eeb8c23c45, entries=2, sequenceid=9, filesize=5.1 K 2023-11-13 04:55:05,578 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 6638aa08a24bc6e34e9840c49e638c8a in 1274ms, sequenceid=9, compaction requested=false 2023-11-13 04:55:05,579 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6638aa08a24bc6e34e9840c49e638c8a: 2023-11-13 04:55:05,579 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a. 2023-11-13 04:55:05,579 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-13 04:55:05,626 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-13 04:55:05,969 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/.tmp/family2/719456a418b4436fa26acb297228e658 2023-11-13 04:55:05,971 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/.tmp/family2/46c6c9a3dbd045e8a34a53ced1c80592 2023-11-13 04:55:05,974 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/.tmp/family1/2ea41d0a5fc141e4ad3d775a051b52a4 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/2ea41d0a5fc141e4ad3d775a051b52a4 2023-11-13 04:55:05,975 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/.tmp/family1/c5987b1cd73845f98c8edc455ccf47dc as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/c5987b1cd73845f98c8edc455ccf47dc 2023-11-13 04:55:05,981 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/2ea41d0a5fc141e4ad3d775a051b52a4, entries=4, sequenceid=9, filesize=5.4 K 2023-11-13 04:55:05,982 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/c5987b1cd73845f98c8edc455ccf47dc, entries=4, sequenceid=9, filesize=5.4 K 2023-11-13 04:55:05,982 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/.tmp/family2/719456a418b4436fa26acb297228e658 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/719456a418b4436fa26acb297228e658 2023-11-13 04:55:05,983 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/.tmp/family2/46c6c9a3dbd045e8a34a53ced1c80592 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/46c6c9a3dbd045e8a34a53ced1c80592 2023-11-13 04:55:05,986 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/719456a418b4436fa26acb297228e658, entries=2, sequenceid=9, filesize=5.1 K 2023-11-13 04:55:05,987 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/46c6c9a3dbd045e8a34a53ced1c80592, entries=2, sequenceid=9, filesize=5.1 K 2023-11-13 04:55:05,987 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for e13efa47a2338bfc8c25006e697a36d8 in 1682ms, sequenceid=9, compaction requested=false 2023-11-13 04:55:05,987 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for e13efa47a2338bfc8c25006e697a36d8: 2023-11-13 04:55:05,987 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8. 2023-11-13 04:55:05,987 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-13 04:55:05,987 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for bfeed2e88ce202cf921374d6d67968c7 in 1682ms, sequenceid=9, compaction requested=false 2023-11-13 04:55:05,987 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for bfeed2e88ce202cf921374d6d67968c7: 2023-11-13 04:55:05,987 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7. 2023-11-13 04:55:05,987 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-13 04:55:05,987 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-13 04:55:05,987 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:05,987 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-13 04:55:05,987 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-13 04:55:05,996 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:05,996 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-13 04:55:05,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:05,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:05,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:05,997 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-13 04:55:05,997 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:55:05,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:05,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:05,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-13 04:55:05,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:05,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:05,998 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-13 04:55:05,998 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c812546[Count = 0] remaining members to acquire global barrier 2023-11-13 04:55:05,998 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-13 04:55:05,998 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-13 04:55:05,999 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-13 04:55:05,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-13 04:55:05,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-13 04:55:05,999 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-13 04:55:05,999 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-13 04:55:05,999 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:55:05,999 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:05,999 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:55:06,001 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:06,001 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-13 04:55:06,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:06,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:06,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:06,002 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:55:06,002 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-13 04:55:06,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:06,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:06,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-13 04:55:06,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:06,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:06,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-13 04:55:06,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:06,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:55:06,004 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-13 04:55:06,004 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-13 04:55:06,004 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:55:06,004 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:55:06,004 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-13 04:55:06,004 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:55:06,006 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-13 04:55:06,006 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-13 04:55:06,006 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:55:06,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-13 04:55:06,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:06,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:06,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-13 04:55:06,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-13 04:55:06,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:06,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:55:06,006 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:06,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:55:06,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-13 04:55:06,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-13 04:55:06,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:06,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-13 04:55:06,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:06,008 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:06,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:06,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-13 04:55:06,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:06,010 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:06,010 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:55:06,010 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-13 04:55:06,010 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:55:06,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:55:06,010 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-13 04:55:06,011 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:55:06,010 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:55:06,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:55:06,010 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-13 04:55:06,011 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:06,011 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-13 04:55:06,011 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-13 04:55:06,011 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-13 04:55:06,011 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-13 04:55:06,011 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:55:06,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:55:06,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:55:06,111 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:55:06,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:55:06,113 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8. with WAL disabled. Data may be lost in the event of a crash. 2023-11-13 04:55:06,113 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a. with WAL disabled. Data may be lost in the event of a crash. 2023-11-13 04:55:06,114 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7. with WAL disabled. Data may be lost in the event of a crash. 2023-11-13 04:55:06,116 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:55:06,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-13 04:55:06,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-13 04:55:06,121 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-13 04:55:06,121 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:55:06,121 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-13 04:55:06,121 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-13 04:55:06,122 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-13 04:55:06,122 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-13 04:55:06,124 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:55:06,124 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:06,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:55:06,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:55:06,124 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:06,124 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:55:06,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-13 04:55:06,125 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-13 04:55:06,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:55:06,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-13 04:55:06,125 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-13 04:55:06,125 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-13 04:55:06,125 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-13 04:55:06,125 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-13 04:55:06,125 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:55:06,125 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-13 04:55:06,126 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a. 2023-11-13 04:55:06,126 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a. started... 2023-11-13 04:55:06,126 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7. 2023-11-13 04:55:06,126 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6638aa08a24bc6e34e9840c49e638c8a 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-13 04:55:06,126 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-13 04:55:06,126 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:55:06,126 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8. 2023-11-13 04:55:06,126 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7. started... 2023-11-13 04:55:06,126 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8. started... 2023-11-13 04:55:06,126 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing e13efa47a2338bfc8c25006e697a36d8 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-13 04:55:06,126 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing bfeed2e88ce202cf921374d6d67968c7 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-13 04:55:06,543 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231113c7bb0d4adb7e47fa816b3246d1d1523e to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231113c7bb0d4adb7e47fa816b3246d1d1523e 2023-11-13 04:55:06,553 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111365f56168a30e4de6aa4908b7a0069dc8 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023111365f56168a30e4de6aa4908b7a0069dc8 2023-11-13 04:55:06,554 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311137b3eadda4c934e8f9d523657a0b77183 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311137b3eadda4c934e8f9d523657a0b77183 2023-11-13 04:55:06,555 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/.tmp/family1/9db28e991279470d84afb14894901a51 2023-11-13 04:55:06,560 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/.tmp/family1/2990516ad7cc46d3b9e125f204a3056a 2023-11-13 04:55:06,569 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231113850b5dc25ed348ca982bca07c46fc7ec to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231113850b5dc25ed348ca982bca07c46fc7ec 2023-11-13 04:55:06,958 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/.tmp/family1/4e0fe736e59d4ea9950d123020a08137 2023-11-13 04:55:06,972 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231113cd6623de188141a491050ec84c9df57b to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231113cd6623de188141a491050ec84c9df57b 2023-11-13 04:55:06,973 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/.tmp/family2/9e729fa6d311473c96c179090d6b8367 2023-11-13 04:55:06,978 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/.tmp/family1/9db28e991279470d84afb14894901a51 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/9db28e991279470d84afb14894901a51 2023-11-13 04:55:06,981 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/9db28e991279470d84afb14894901a51, entries=4, sequenceid=13, filesize=5.4 K 2023-11-13 04:55:06,981 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/.tmp/family2/9e729fa6d311473c96c179090d6b8367 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/9e729fa6d311473c96c179090d6b8367 2023-11-13 04:55:06,985 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/9e729fa6d311473c96c179090d6b8367, entries=2, sequenceid=13, filesize=5.1 K 2023-11-13 04:55:06,985 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 6638aa08a24bc6e34e9840c49e638c8a in 859ms, sequenceid=13, compaction requested=true 2023-11-13 04:55:06,985 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6638aa08a24bc6e34e9840c49e638c8a: 2023-11-13 04:55:06,986 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a. 2023-11-13 04:55:06,986 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-13 04:55:07,372 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311132d54a04b895f4a33a0655831e481ee23 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311132d54a04b895f4a33a0655831e481ee23 2023-11-13 04:55:07,377 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/.tmp/family2/ed2295265451475b90c1bdcd90481da6 2023-11-13 04:55:07,380 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/.tmp/family1/2990516ad7cc46d3b9e125f204a3056a as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/2990516ad7cc46d3b9e125f204a3056a 2023-11-13 04:55:07,383 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/2990516ad7cc46d3b9e125f204a3056a, entries=4, sequenceid=13, filesize=5.4 K 2023-11-13 04:55:07,384 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/.tmp/family2/ed2295265451475b90c1bdcd90481da6 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/ed2295265451475b90c1bdcd90481da6 2023-11-13 04:55:07,387 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/ed2295265451475b90c1bdcd90481da6, entries=2, sequenceid=13, filesize=5.1 K 2023-11-13 04:55:07,388 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for bfeed2e88ce202cf921374d6d67968c7 in 1262ms, sequenceid=13, compaction requested=true 2023-11-13 04:55:07,388 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for bfeed2e88ce202cf921374d6d67968c7: 2023-11-13 04:55:07,388 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7. 2023-11-13 04:55:07,388 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-13 04:55:07,776 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/.tmp/family2/52d64f3aa1c842828ad355d41c232a9a 2023-11-13 04:55:07,781 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/.tmp/family1/4e0fe736e59d4ea9950d123020a08137 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/4e0fe736e59d4ea9950d123020a08137 2023-11-13 04:55:07,784 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/4e0fe736e59d4ea9950d123020a08137, entries=4, sequenceid=13, filesize=5.4 K 2023-11-13 04:55:07,785 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/.tmp/family2/52d64f3aa1c842828ad355d41c232a9a as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/52d64f3aa1c842828ad355d41c232a9a 2023-11-13 04:55:07,788 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/52d64f3aa1c842828ad355d41c232a9a, entries=2, sequenceid=13, filesize=5.1 K 2023-11-13 04:55:07,789 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for e13efa47a2338bfc8c25006e697a36d8 in 1663ms, sequenceid=13, compaction requested=true 2023-11-13 04:55:07,789 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for e13efa47a2338bfc8c25006e697a36d8: 2023-11-13 04:55:07,789 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8. 2023-11-13 04:55:07,789 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-13 04:55:07,789 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-13 04:55:07,789 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:07,789 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-13 04:55:07,789 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-13 04:55:07,791 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:07,791 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-13 04:55:07,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:07,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:07,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:07,792 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-13 04:55:07,792 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:55:07,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:07,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:07,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-13 04:55:07,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:07,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:07,793 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-13 04:55:07,793 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b8034df[Count = 0] remaining members to acquire global barrier 2023-11-13 04:55:07,793 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-13 04:55:07,793 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-13 04:55:07,795 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-13 04:55:07,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-13 04:55:07,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-13 04:55:07,795 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-13 04:55:07,795 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-13 04:55:07,795 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:55:07,795 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:07,796 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:55:07,797 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:07,797 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-13 04:55:07,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:07,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:07,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:07,797 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:55:07,797 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-13 04:55:07,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:07,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:07,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-13 04:55:07,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:07,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:07,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-13 04:55:07,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:07,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:55:07,799 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-13 04:55:07,799 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-13 04:55:07,799 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:55:07,799 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:55:07,799 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-13 04:55:07,799 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:55:07,801 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-13 04:55:07,801 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-13 04:55:07,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-13 04:55:07,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-13 04:55:07,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-13 04:55:07,801 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:55:07,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:07,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:07,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:55:07,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:07,802 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:07,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:55:07,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-13 04:55:07,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-13 04:55:07,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:07,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-13 04:55:07,803 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:07,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:07,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:07,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-13 04:55:07,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:07,805 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:07,805 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-13 04:55:07,805 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:55:07,805 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-13 04:55:07,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:55:07,805 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:55:07,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:55:07,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-13 04:55:07,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:55:07,805 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:07,805 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:55:07,805 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-13 04:55:07,805 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-13 04:55:07,806 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-13 04:55:07,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:55:07,806 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-13 04:55:07,805 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-13 04:55:07,806 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:55:07,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:55:07,906 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:55:07,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:55:07,908 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8. with WAL disabled. Data may be lost in the event of a crash. 2023-11-13 04:55:07,908 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a. with WAL disabled. Data may be lost in the event of a crash. 2023-11-13 04:55:07,908 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7. with WAL disabled. Data may be lost in the event of a crash. 2023-11-13 04:55:07,910 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:55:07,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-13 04:55:07,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-13 04:55:07,913 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-13 04:55:07,913 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:55:07,913 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-13 04:55:07,913 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-13 04:55:07,913 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-13 04:55:07,913 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-13 04:55:07,914 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:07,914 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:55:07,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:55:07,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:55:07,915 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:07,915 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:55:07,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-13 04:55:07,915 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-13 04:55:07,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:55:07,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-13 04:55:07,916 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-13 04:55:07,916 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-13 04:55:07,916 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-13 04:55:07,916 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-13 04:55:07,916 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:55:07,916 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-13 04:55:07,916 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a. 2023-11-13 04:55:07,916 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a. started... 2023-11-13 04:55:07,916 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-13 04:55:07,916 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:55:07,916 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8. 2023-11-13 04:55:07,916 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8. started... 2023-11-13 04:55:07,916 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7. 2023-11-13 04:55:07,916 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6638aa08a24bc6e34e9840c49e638c8a 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-13 04:55:07,916 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing e13efa47a2338bfc8c25006e697a36d8 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-13 04:55:07,916 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7. started... 2023-11-13 04:55:07,917 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing bfeed2e88ce202cf921374d6d67968c7 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-13 04:55:08,332 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231113dd59155911b448159fdd1cef1c0b1083 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231113dd59155911b448159fdd1cef1c0b1083 2023-11-13 04:55:08,332 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231113f2f4bd37329a480bbfee9819afebc9a3 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231113f2f4bd37329a480bbfee9819afebc9a3 2023-11-13 04:55:08,332 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311138a7e2bf3f47841619b334d10c3ce3fd4 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311138a7e2bf3f47841619b334d10c3ce3fd4 2023-11-13 04:55:08,747 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/.tmp/family1/0b548a931acb440487d096ffaf5c6b41 2023-11-13 04:55:08,749 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/.tmp/family1/7fb2b16fcf754db5864380917a8c5ea9 2023-11-13 04:55:08,750 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/.tmp/family1/08fde853956a475e89743233b5800da0 2023-11-13 04:55:09,174 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311132158d5340c38487e8ae0c5ed11be2314 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311132158d5340c38487e8ae0c5ed11be2314 2023-11-13 04:55:09,176 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231113b6d9022a12af4fe8a9073d8529f1c53f to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231113b6d9022a12af4fe8a9073d8529f1c53f 2023-11-13 04:55:09,176 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231113de726c0b2aca43acb6c2a70fa4a3634a to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231113de726c0b2aca43acb6c2a70fa4a3634a 2023-11-13 04:55:09,184 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/.tmp/family2/f6fb49bb4ab442b39a424a889d8ab93e 2023-11-13 04:55:09,189 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/.tmp/family1/08fde853956a475e89743233b5800da0 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/08fde853956a475e89743233b5800da0 2023-11-13 04:55:09,193 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/08fde853956a475e89743233b5800da0, entries=4, sequenceid=17, filesize=5.4 K 2023-11-13 04:55:09,194 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/.tmp/family2/f6fb49bb4ab442b39a424a889d8ab93e as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/f6fb49bb4ab442b39a424a889d8ab93e 2023-11-13 04:55:09,198 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/f6fb49bb4ab442b39a424a889d8ab93e, entries=2, sequenceid=17, filesize=5.1 K 2023-11-13 04:55:09,199 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 6638aa08a24bc6e34e9840c49e638c8a in 1283ms, sequenceid=17, compaction requested=true 2023-11-13 04:55:09,199 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6638aa08a24bc6e34e9840c49e638c8a: 2023-11-13 04:55:09,199 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a. 2023-11-13 04:55:09,199 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-13 04:55:09,582 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/.tmp/family2/d7c4c89b37e547b6a119da3fe0471bf1 2023-11-13 04:55:09,584 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/.tmp/family2/c6aa2bd8bb014b1a9a42a050ee5af1d6 2023-11-13 04:55:09,587 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/.tmp/family1/0b548a931acb440487d096ffaf5c6b41 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/0b548a931acb440487d096ffaf5c6b41 2023-11-13 04:55:09,588 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/.tmp/family1/7fb2b16fcf754db5864380917a8c5ea9 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/7fb2b16fcf754db5864380917a8c5ea9 2023-11-13 04:55:09,590 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/0b548a931acb440487d096ffaf5c6b41, entries=4, sequenceid=17, filesize=5.4 K 2023-11-13 04:55:09,591 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/.tmp/family2/d7c4c89b37e547b6a119da3fe0471bf1 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/d7c4c89b37e547b6a119da3fe0471bf1 2023-11-13 04:55:09,592 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/7fb2b16fcf754db5864380917a8c5ea9, entries=4, sequenceid=17, filesize=5.4 K 2023-11-13 04:55:09,592 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/.tmp/family2/c6aa2bd8bb014b1a9a42a050ee5af1d6 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/c6aa2bd8bb014b1a9a42a050ee5af1d6 2023-11-13 04:55:09,595 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/d7c4c89b37e547b6a119da3fe0471bf1, entries=2, sequenceid=17, filesize=5.1 K 2023-11-13 04:55:09,596 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for e13efa47a2338bfc8c25006e697a36d8 in 1680ms, sequenceid=17, compaction requested=true 2023-11-13 04:55:09,596 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for e13efa47a2338bfc8c25006e697a36d8: 2023-11-13 04:55:09,596 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8. 2023-11-13 04:55:09,596 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-13 04:55:09,596 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/c6aa2bd8bb014b1a9a42a050ee5af1d6, entries=2, sequenceid=17, filesize=5.1 K 2023-11-13 04:55:09,597 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for bfeed2e88ce202cf921374d6d67968c7 in 1680ms, sequenceid=17, compaction requested=true 2023-11-13 04:55:09,597 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for bfeed2e88ce202cf921374d6d67968c7: 2023-11-13 04:55:09,597 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7. 2023-11-13 04:55:09,597 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-13 04:55:09,597 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-13 04:55:09,597 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:09,597 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-13 04:55:09,597 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-13 04:55:09,599 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-13 04:55:09,599 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:09,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:09,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:09,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:09,599 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-13 04:55:09,599 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:55:09,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:09,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:09,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-13 04:55:09,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:09,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:09,600 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-13 04:55:09,600 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@31f14248[Count = 0] remaining members to acquire global barrier 2023-11-13 04:55:09,600 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-13 04:55:09,600 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-13 04:55:09,602 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-13 04:55:09,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-13 04:55:09,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-13 04:55:09,602 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-13 04:55:09,603 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-13 04:55:09,603 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:55:09,603 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:09,603 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:55:09,604 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-13 04:55:09,604 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:09,604 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:55:09,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:09,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:09,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:09,604 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-13 04:55:09,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:09,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:09,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-13 04:55:09,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:09,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:09,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-13 04:55:09,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:09,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:55:09,606 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-13 04:55:09,606 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:55:09,606 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:55:09,606 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-13 04:55:09,606 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:55:09,606 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-13 04:55:09,608 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-13 04:55:09,608 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-13 04:55:09,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-13 04:55:09,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-13 04:55:09,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:09,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:09,608 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:55:09,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-13 04:55:09,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:09,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:55:09,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:55:09,608 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:09,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-13 04:55:09,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-13 04:55:09,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:09,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-13 04:55:09,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:09,610 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:09,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:09,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-13 04:55:09,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:09,612 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:09,612 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-13 04:55:09,612 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:55:09,612 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:55:09,612 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-13 04:55:09,612 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:55:09,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:55:09,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:55:09,612 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-13 04:55:09,612 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:55:09,612 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:09,612 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-13 04:55:09,612 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-13 04:55:09,612 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-13 04:55:09,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:55:09,612 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-13 04:55:09,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:55:09,612 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:55:09,713 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:55:09,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:55:09,723 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb-1699851309714 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-13 04:55:09,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1699851309723 (current time:1699851309723). 2023-11-13 04:55:09,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-11-13 04:55:09,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] zookeeper.ReadOnlyZKClient(139): Connect 0x0c71cba9 to 127.0.0.1:51072 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-13 04:55:09,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b99d25b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-13 04:55:09,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-13 04:55:09,738 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34826, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-13 04:55:09,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0c71cba9 to 127.0.0.1:51072 2023-11-13 04:55:09,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-13 04:55:09,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-11-13 04:55:09,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb-1699851309714 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-13 04:55:09,751 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.hbase-snapshot, current working dir path: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.hbase-snapshot/.tmp/snaptb-1699851309714 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-11-13 04:55:09,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure2.ProcedureExecutor(1028): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-13 04:55:09,761 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-13 04:55:09,762 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1699851909762 2023-11-13 04:55:09,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb-1699851309714 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-13 04:55:09,762 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1699851309714 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-11-13 04:55:09,763 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-13 04:55:09,764 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-13 04:55:09,764 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 3 msec 2023-11-13 04:55:09,765 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-13 04:55:09,766 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1699851909766 2023-11-13 04:55:09,768 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1699851309714 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-11-13 04:55:09,768 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-11-13 04:55:09,776 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1699851309714 2023-11-13 04:55:09,776 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1699851309714' 2023-11-13 04:55:09,776 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-11-13 04:55:09,776 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1699851309714' starting 'acquire' 2023-11-13 04:55:09,776 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1699851309714', kicking off acquire phase on members. 2023-11-13 04:55:09,777 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1699851309714 2023-11-13 04:55:09,777 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1699851309714 2023-11-13 04:55:09,778 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-11-13 04:55:09,778 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1699851309714/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:09,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-11-13 04:55:09,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-13 04:55:09,779 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1699851309714/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:09,779 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:55:09,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1699851309714 2023-11-13 04:55:09,779 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1699851309714 2023-11-13 04:55:09,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-11-13 04:55:09,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1699851309714 2023-11-13 04:55:09,780 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1699851309714 from table testCompactionWithHFileLink type FLUSH 2023-11-13 04:55:09,783 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1699851309714 2023-11-13 04:55:09,783 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1699851309714' with timeout 300000ms 2023-11-13 04:55:09,783 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-11-13 04:55:09,783 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1699851309714' starting 'acquire' stage 2023-11-13 04:55:09,783 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1699851309714' locally acquired 2023-11-13 04:55:09,783 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (snaptb-1699851309714) in zk 2023-11-13 04:55:09,785 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1699851309714/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:09,785 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1699851309714 2023-11-13 04:55:09,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1699851309714/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:09,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:09,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-13 04:55:09,786 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1699851309714 2023-11-13 04:55:09,786 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1699851309714' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:55:09,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:09,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:09,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1699851309714 2023-11-13 04:55:09,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:09,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:09,788 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'snaptb-1699851309714' on coordinator 2023-11-13 04:55:09,788 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1466e8b6[Count = 0] remaining members to acquire global barrier 2023-11-13 04:55:09,788 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1699851309714' starting 'in-barrier' execution. 2023-11-13 04:55:09,788 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1699851309714 2023-11-13 04:55:09,792 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1699851309714 2023-11-13 04:55:09,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1699851309714 2023-11-13 04:55:09,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1699851309714 2023-11-13 04:55:09,792 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1699851309714' received 'reached' from coordinator. 2023-11-13 04:55:09,792 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1699851309714/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:09,792 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:55:09,793 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a. 2023-11-13 04:55:09,793 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7. 2023-11-13 04:55:09,793 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8. 2023-11-13 04:55:09,793 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-11-13 04:55:09,793 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-11-13 04:55:09,794 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7. started... 2023-11-13 04:55:09,794 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a. started... 2023-11-13 04:55:09,794 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8. started... 2023-11-13 04:55:09,794 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-snapshot-pool-1] regionserver.HRegion(2446): Flush status journal for bfeed2e88ce202cf921374d6d67968c7: 2023-11-13 04:55:09,794 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-snapshot-pool-2] regionserver.HRegion(2446): Flush status journal for e13efa47a2338bfc8c25006e697a36d8: 2023-11-13 04:55:09,794 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6638aa08a24bc6e34e9840c49e638c8a: 2023-11-13 04:55:09,795 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a.' region-info for snapshot=snaptb-1699851309714 2023-11-13 04:55:09,795 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8.' region-info for snapshot=snaptb-1699851309714 2023-11-13 04:55:09,795 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7.' region-info for snapshot=snaptb-1699851309714 2023-11-13 04:55:09,801 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-13 04:55:09,801 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-13 04:55:09,801 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-13 04:55:09,805 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/12c93e792bf84957ac292148d77afa10, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/4a4345fbfaf544a4bca8220aa5491d91, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/9db28e991279470d84afb14894901a51, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/08fde853956a475e89743233b5800da0] hfiles 2023-11-13 04:55:09,805 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/390824bbfce04fd9ac1b935a17760523, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/2ea41d0a5fc141e4ad3d775a051b52a4, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/4e0fe736e59d4ea9950d123020a08137, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/0b548a931acb440487d096ffaf5c6b41] hfiles 2023-11-13 04:55:09,805 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/12c93e792bf84957ac292148d77afa10 for snapshot=snaptb-1699851309714 2023-11-13 04:55:09,805 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/fccd59c304254894860a914ea6db14f2, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/c5987b1cd73845f98c8edc455ccf47dc, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/2990516ad7cc46d3b9e125f204a3056a, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/7fb2b16fcf754db5864380917a8c5ea9] hfiles 2023-11-13 04:55:09,805 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/390824bbfce04fd9ac1b935a17760523 for snapshot=snaptb-1699851309714 2023-11-13 04:55:09,805 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/fccd59c304254894860a914ea6db14f2 for snapshot=snaptb-1699851309714 2023-11-13 04:55:09,808 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/4a4345fbfaf544a4bca8220aa5491d91 for snapshot=snaptb-1699851309714 2023-11-13 04:55:09,808 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/2ea41d0a5fc141e4ad3d775a051b52a4 for snapshot=snaptb-1699851309714 2023-11-13 04:55:09,808 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/c5987b1cd73845f98c8edc455ccf47dc for snapshot=snaptb-1699851309714 2023-11-13 04:55:09,808 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/4e0fe736e59d4ea9950d123020a08137 for snapshot=snaptb-1699851309714 2023-11-13 04:55:09,808 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/2990516ad7cc46d3b9e125f204a3056a for snapshot=snaptb-1699851309714 2023-11-13 04:55:09,808 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/0b548a931acb440487d096ffaf5c6b41 for snapshot=snaptb-1699851309714 2023-11-13 04:55:09,808 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/9db28e991279470d84afb14894901a51 for snapshot=snaptb-1699851309714 2023-11-13 04:55:09,808 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/7fb2b16fcf754db5864380917a8c5ea9 for snapshot=snaptb-1699851309714 2023-11-13 04:55:09,809 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/425709ac686d4a6599e4146cbc4e1457, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/719456a418b4436fa26acb297228e658, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/52d64f3aa1c842828ad355d41c232a9a, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/d7c4c89b37e547b6a119da3fe0471bf1] hfiles 2023-11-13 04:55:09,809 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/8f39ca4d1f2047799898b9eb81767fb1, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/46c6c9a3dbd045e8a34a53ced1c80592, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/ed2295265451475b90c1bdcd90481da6, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/c6aa2bd8bb014b1a9a42a050ee5af1d6] hfiles 2023-11-13 04:55:09,809 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/08fde853956a475e89743233b5800da0 for snapshot=snaptb-1699851309714 2023-11-13 04:55:09,809 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/8f39ca4d1f2047799898b9eb81767fb1 for snapshot=snaptb-1699851309714 2023-11-13 04:55:09,809 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/86886665116d4ba293a13c09aedad26a, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/3a385363c38c493db398a3eeb8c23c45, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/9e729fa6d311473c96c179090d6b8367, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/f6fb49bb4ab442b39a424a889d8ab93e] hfiles 2023-11-13 04:55:09,809 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/46c6c9a3dbd045e8a34a53ced1c80592 for snapshot=snaptb-1699851309714 2023-11-13 04:55:09,809 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/425709ac686d4a6599e4146cbc4e1457 for snapshot=snaptb-1699851309714 2023-11-13 04:55:09,809 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/ed2295265451475b90c1bdcd90481da6 for snapshot=snaptb-1699851309714 2023-11-13 04:55:09,809 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/86886665116d4ba293a13c09aedad26a for snapshot=snaptb-1699851309714 2023-11-13 04:55:09,809 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/c6aa2bd8bb014b1a9a42a050ee5af1d6 for snapshot=snaptb-1699851309714 2023-11-13 04:55:09,809 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/719456a418b4436fa26acb297228e658 for snapshot=snaptb-1699851309714 2023-11-13 04:55:09,809 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/3a385363c38c493db398a3eeb8c23c45 for snapshot=snaptb-1699851309714 2023-11-13 04:55:09,809 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/52d64f3aa1c842828ad355d41c232a9a for snapshot=snaptb-1699851309714 2023-11-13 04:55:09,809 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/9e729fa6d311473c96c179090d6b8367 for snapshot=snaptb-1699851309714 2023-11-13 04:55:09,809 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/d7c4c89b37e547b6a119da3fe0471bf1 for snapshot=snaptb-1699851309714 2023-11-13 04:55:09,809 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/f6fb49bb4ab442b39a424a889d8ab93e for snapshot=snaptb-1699851309714 2023-11-13 04:55:09,819 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8. completed. 2023-11-13 04:55:09,820 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8. 2023-11-13 04:55:09,820 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-11-13 04:55:09,869 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-13 04:55:09,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1699851309714 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-13 04:55:09,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1699851309714 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-13 04:55:09,872 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-11-13 04:55:10,072 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-13 04:55:10,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1699851309714 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-13 04:55:10,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1699851309714 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-13 04:55:10,073 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-11-13 04:55:10,220 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a. completed. 2023-11-13 04:55:10,220 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a. 2023-11-13 04:55:10,220 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-11-13 04:55:10,224 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7. completed. 2023-11-13 04:55:10,225 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7. 2023-11-13 04:55:10,225 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-11-13 04:55:10,225 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-11-13 04:55:10,225 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:10,225 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1699851309714' locally completed 2023-11-13 04:55:10,225 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1699851309714' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:55:10,227 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1699851309714' has notified controller of completion 2023-11-13 04:55:10,227 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1699851309714/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:10,227 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:55:10,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1699851309714/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:10,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:10,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-13 04:55:10,227 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1699851309714' completed. 2023-11-13 04:55:10,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:10,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:10,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1699851309714 2023-11-13 04:55:10,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:10,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:10,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1699851309714 2023-11-13 04:55:10,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:10,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1699851309714' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:55:10,229 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'snaptb-1699851309714', counting down latch. Waiting for 0 more 2023-11-13 04:55:10,229 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1699851309714' execution completed 2023-11-13 04:55:10,230 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:55:10,230 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:55:10,230 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1699851309714 2023-11-13 04:55:10,230 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1699851309714including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-11-13 04:55:10,231 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1699851309714 2023-11-13 04:55:10,231 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1699851309714 2023-11-13 04:55:10,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1699851309714 2023-11-13 04:55:10,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1699851309714 2023-11-13 04:55:10,232 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-11-13 04:55:10,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1699851309714 2023-11-13 04:55:10,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:10,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-13 04:55:10,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-11-13 04:55:10,232 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1699851309714/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:10,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:10,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-13 04:55:10,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1699851309714 2023-11-13 04:55:10,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1699851309714 2023-11-13 04:55:10,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:10,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1699851309714 2023-11-13 04:55:10,237 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1699851309714/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:10,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:10,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:10,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1699851309714 2023-11-13 04:55:10,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:10,240 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1699851309714/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:10,240 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-11-13 04:55:10,240 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1699851309714 2023-11-13 04:55:10,240 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-11-13 04:55:10,240 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1699851309714 2023-11-13 04:55:10,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-11-13 04:55:10,240 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1699851309714 2023-11-13 04:55:10,240 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb-1699851309714 because node does not exist (not an error) 2023-11-13 04:55:10,240 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-11-13 04:55:10,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-13 04:55:10,240 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:55:10,240 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1699851309714/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:10,240 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1699851309714 2023-11-13 04:55:10,240 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1699851309714 2023-11-13 04:55:10,240 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-11-13 04:55:10,240 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1699851309714 2023-11-13 04:55:10,240 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1699851309714 2023-11-13 04:55:10,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-11-13 04:55:10,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-13 04:55:10,242 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023111343a962cdb9454855b1cba6892085e038, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231113a01b6cba5f564864bf45c965c8cd4871, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231113c7bb0d4adb7e47fa816b3246d1d1523e, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231113f2f4bd37329a480bbfee9819afebc9a3, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311137b3eadda4c934e8f9d523657a0b77183, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231113a253e2457d5f435ebee6f1ee36f55d25, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231113dd59155911b448159fdd1cef1c0b1083, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231113f6671f6d9d62429f971e5c2dd1292622, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023111365f56168a30e4de6aa4908b7a0069dc8, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023111378016b094e234a4386415dae4a14c642, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023111382d6195e776e49da80fb040337f6e2f1, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311138a7e2bf3f47841619b334d10c3ce3fd4] mob files 2023-11-13 04:55:10,242 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023111343a962cdb9454855b1cba6892085e038 2023-11-13 04:55:10,242 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231113a01b6cba5f564864bf45c965c8cd4871 2023-11-13 04:55:10,242 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231113c7bb0d4adb7e47fa816b3246d1d1523e 2023-11-13 04:55:10,242 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231113f2f4bd37329a480bbfee9819afebc9a3 2023-11-13 04:55:10,242 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311137b3eadda4c934e8f9d523657a0b77183 2023-11-13 04:55:10,242 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231113a253e2457d5f435ebee6f1ee36f55d25 2023-11-13 04:55:10,242 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231113dd59155911b448159fdd1cef1c0b1083 2023-11-13 04:55:10,242 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231113f6671f6d9d62429f971e5c2dd1292622 2023-11-13 04:55:10,242 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023111365f56168a30e4de6aa4908b7a0069dc8 2023-11-13 04:55:10,242 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023111378016b094e234a4386415dae4a14c642 2023-11-13 04:55:10,242 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023111382d6195e776e49da80fb040337f6e2f1 2023-11-13 04:55:10,242 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311138a7e2bf3f47841619b334d10c3ce3fd4 2023-11-13 04:55:10,243 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231113071d0287206243239789636b4dc85b96, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231113850b5dc25ed348ca982bca07c46fc7ec, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231113de726c0b2aca43acb6c2a70fa4a3634a, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231113e8e4613a8a8f4269bee5ece2df9b6412, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023111351e97193a3d546a7a8b08e3a25a5f470, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231113939643500d7b477fad4541b401fc96a8, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231113b6d9022a12af4fe8a9073d8529f1c53f, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231113cd6623de188141a491050ec84c9df57b, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311132158d5340c38487e8ae0c5ed11be2314, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311132d54a04b895f4a33a0655831e481ee23, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111346efaa5f2574453c9dbabc830b5d3db4, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111390eeffa2d10541da821f54f8dd3aa9e0] mob files 2023-11-13 04:55:10,243 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231113071d0287206243239789636b4dc85b96 2023-11-13 04:55:10,243 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231113850b5dc25ed348ca982bca07c46fc7ec 2023-11-13 04:55:10,243 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231113de726c0b2aca43acb6c2a70fa4a3634a 2023-11-13 04:55:10,244 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231113e8e4613a8a8f4269bee5ece2df9b6412 2023-11-13 04:55:10,244 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023111351e97193a3d546a7a8b08e3a25a5f470 2023-11-13 04:55:10,244 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231113939643500d7b477fad4541b401fc96a8 2023-11-13 04:55:10,244 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231113b6d9022a12af4fe8a9073d8529f1c53f 2023-11-13 04:55:10,244 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231113cd6623de188141a491050ec84c9df57b 2023-11-13 04:55:10,244 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311132158d5340c38487e8ae0c5ed11be2314 2023-11-13 04:55:10,244 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311132d54a04b895f4a33a0655831e481ee23 2023-11-13 04:55:10,244 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111346efaa5f2574453c9dbabc830b5d3db4 2023-11-13 04:55:10,244 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111390eeffa2d10541da821f54f8dd3aa9e0 2023-11-13 04:55:10,374 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-13 04:55:10,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1699851309714 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-13 04:55:10,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1699851309714 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-13 04:55:10,375 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-11-13 04:55:10,649 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1699851309714 2023-11-13 04:55:10,651 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.hbase-snapshot/.tmp/snaptb-1699851309714 2023-11-13 04:55:10,875 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-13 04:55:10,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1699851309714 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-13 04:55:10,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1699851309714 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-13 04:55:10,876 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-11-13 04:55:11,096 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.hbase-snapshot/.tmp/snaptb-1699851309714 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.hbase-snapshot/snaptb-1699851309714 2023-11-13 04:55:11,097 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1699851309714 of table testCompactionWithHFileLink completed 2023-11-13 04:55:11,097 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.hbase-snapshot/.tmp/snaptb-1699851309714 2023-11-13 04:55:11,098 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.hbase-snapshot/.tmp/snaptb-1699851309714 2023-11-13 04:55:11,098 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1699851309714 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1699851309762Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1699851310649 (+887 ms)Consolidate snapshot: snaptb-1699851309714 at 1699851310649Loading Region manifests for snaptb-1699851309714 at 1699851310649Writing data manifest for snaptb-1699851309714 at 1699851310659 (+10 ms)Verifying snapshot: snaptb-1699851309714 at 1699851311065 (+406 ms)Snapshot snaptb-1699851309714 of table testCompactionWithHFileLink completed at 1699851311097 (+32 ms) 2023-11-13 04:55:11,099 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-13 04:55:11,100 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 1.3360 sec 2023-11-13 04:55:11,876 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-13 04:55:11,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1699851309714 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-13 04:55:11,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb-1699851309714 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-11-13 04:55:11,910 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:55:11,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-13 04:55:11,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-13 04:55:11,912 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-13 04:55:11,912 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:55:11,912 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-13 04:55:11,912 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-13 04:55:11,913 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-13 04:55:11,913 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-13 04:55:11,914 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:11,914 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:55:11,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:55:11,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:55:11,915 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:11,915 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:55:11,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-13 04:55:11,915 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-13 04:55:11,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:55:11,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-13 04:55:11,916 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-13 04:55:11,916 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-13 04:55:11,916 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-13 04:55:11,916 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-13 04:55:11,916 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:55:11,916 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-13 04:55:11,916 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a. 2023-11-13 04:55:11,916 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7. 2023-11-13 04:55:11,917 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a. started... 2023-11-13 04:55:11,917 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7. started... 2023-11-13 04:55:11,917 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-13 04:55:11,917 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing bfeed2e88ce202cf921374d6d67968c7 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-13 04:55:11,917 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8. 2023-11-13 04:55:11,917 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:55:11,917 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6638aa08a24bc6e34e9840c49e638c8a 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-13 04:55:11,917 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8. started... 2023-11-13 04:55:11,917 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing e13efa47a2338bfc8c25006e697a36d8 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-13 04:55:12,750 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/.tmp/family1/260526dd65b6451bac5f04fb8f3d5251 2023-11-13 04:55:12,756 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 260526dd65b6451bac5f04fb8f3d5251 2023-11-13 04:55:12,759 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/.tmp/family1/44e40cd075184923af060f62c744bb1d 2023-11-13 04:55:12,765 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/.tmp/family1/dfdc95ebf1a0451ca961aae7201a3296 2023-11-13 04:55:12,770 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dfdc95ebf1a0451ca961aae7201a3296 2023-11-13 04:55:12,776 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 44e40cd075184923af060f62c744bb1d 2023-11-13 04:55:12,810 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/.tmp/family2/ec46faa226d64a418d726ea828fcdab3 2023-11-13 04:55:12,816 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ec46faa226d64a418d726ea828fcdab3 2023-11-13 04:55:12,817 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/.tmp/family1/260526dd65b6451bac5f04fb8f3d5251 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/260526dd65b6451bac5f04fb8f3d5251 2023-11-13 04:55:12,821 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 260526dd65b6451bac5f04fb8f3d5251 2023-11-13 04:55:12,821 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/260526dd65b6451bac5f04fb8f3d5251, entries=3, sequenceid=24, filesize=5.0 K 2023-11-13 04:55:12,822 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/.tmp/family2/ec46faa226d64a418d726ea828fcdab3 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/ec46faa226d64a418d726ea828fcdab3 2023-11-13 04:55:12,826 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ec46faa226d64a418d726ea828fcdab3 2023-11-13 04:55:12,827 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/ec46faa226d64a418d726ea828fcdab3, entries=1, sequenceid=24, filesize=5.0 K 2023-11-13 04:55:12,827 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 6638aa08a24bc6e34e9840c49e638c8a in 910ms, sequenceid=24, compaction requested=true 2023-11-13 04:55:12,828 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6638aa08a24bc6e34e9840c49e638c8a: 2023-11-13 04:55:12,828 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a. 2023-11-13 04:55:12,828 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-13 04:55:13,207 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/.tmp/family2/9965648b95854ca2a3c70b8e401b86c1 2023-11-13 04:55:13,213 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9965648b95854ca2a3c70b8e401b86c1 2023-11-13 04:55:13,214 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/.tmp/family2/e44c778128c94befaff591612975c2be 2023-11-13 04:55:13,214 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/.tmp/family1/dfdc95ebf1a0451ca961aae7201a3296 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/dfdc95ebf1a0451ca961aae7201a3296 2023-11-13 04:55:13,220 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dfdc95ebf1a0451ca961aae7201a3296 2023-11-13 04:55:13,220 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/dfdc95ebf1a0451ca961aae7201a3296, entries=3, sequenceid=24, filesize=5.0 K 2023-11-13 04:55:13,221 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/.tmp/family2/9965648b95854ca2a3c70b8e401b86c1 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/9965648b95854ca2a3c70b8e401b86c1 2023-11-13 04:55:13,231 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e44c778128c94befaff591612975c2be 2023-11-13 04:55:13,232 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/.tmp/family1/44e40cd075184923af060f62c744bb1d as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/44e40cd075184923af060f62c744bb1d 2023-11-13 04:55:13,232 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9965648b95854ca2a3c70b8e401b86c1 2023-11-13 04:55:13,233 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/9965648b95854ca2a3c70b8e401b86c1, entries=1, sequenceid=24, filesize=5.0 K 2023-11-13 04:55:13,234 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for e13efa47a2338bfc8c25006e697a36d8 in 1317ms, sequenceid=24, compaction requested=true 2023-11-13 04:55:13,234 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for e13efa47a2338bfc8c25006e697a36d8: 2023-11-13 04:55:13,234 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8. 2023-11-13 04:55:13,234 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-13 04:55:13,237 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 44e40cd075184923af060f62c744bb1d 2023-11-13 04:55:13,237 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/44e40cd075184923af060f62c744bb1d, entries=3, sequenceid=24, filesize=5.0 K 2023-11-13 04:55:13,238 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/.tmp/family2/e44c778128c94befaff591612975c2be as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/e44c778128c94befaff591612975c2be 2023-11-13 04:55:13,242 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e44c778128c94befaff591612975c2be 2023-11-13 04:55:13,242 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/e44c778128c94befaff591612975c2be, entries=1, sequenceid=24, filesize=5.0 K 2023-11-13 04:55:13,243 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for bfeed2e88ce202cf921374d6d67968c7 in 1326ms, sequenceid=24, compaction requested=true 2023-11-13 04:55:13,243 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for bfeed2e88ce202cf921374d6d67968c7: 2023-11-13 04:55:13,243 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7. 2023-11-13 04:55:13,243 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-13 04:55:13,243 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-13 04:55:13,243 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:13,244 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-13 04:55:13,244 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-13 04:55:13,246 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:13,246 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-13 04:55:13,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:13,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:13,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:13,247 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-13 04:55:13,247 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:55:13,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:13,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:13,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-13 04:55:13,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:13,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:13,248 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-13 04:55:13,249 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@31685469[Count = 0] remaining members to acquire global barrier 2023-11-13 04:55:13,249 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-13 04:55:13,249 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-13 04:55:13,250 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:13,250 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:55:13,253 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-13 04:55:13,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-13 04:55:13,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-13 04:55:13,253 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-13 04:55:13,253 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-13 04:55:13,253 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:55:13,254 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:13,254 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-13 04:55:13,255 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:55:13,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:13,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:13,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:13,255 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-13 04:55:13,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:13,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:13,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-13 04:55:13,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:13,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:13,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-13 04:55:13,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:13,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:55:13,258 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-13 04:55:13,258 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-13 04:55:13,258 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:55:13,258 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:55:13,258 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-13 04:55:13,258 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:55:13,263 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-13 04:55:13,263 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-13 04:55:13,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-13 04:55:13,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-13 04:55:13,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:13,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-13 04:55:13,263 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:55:13,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:13,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:55:13,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:55:13,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:13,264 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:13,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-13 04:55:13,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-13 04:55:13,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:13,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-13 04:55:13,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:13,265 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:13,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:13,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-13 04:55:13,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:13,268 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:13,268 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-13 04:55:13,268 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-13 04:55:13,268 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:13,268 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-13 04:55:13,268 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:55:13,268 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-13 04:55:13,268 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:55:13,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:55:13,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:55:13,268 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-13 04:55:13,268 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:55:13,268 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-13 04:55:13,268 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:55:13,268 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:55:13,268 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-13 04:55:13,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:55:13,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:55:13,269 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-13 04:55:13,369 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:55:13,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:55:13,370 DEBUG [Listener at localhost/34517] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-13 04:55:13,370 DEBUG [Listener at localhost/34517] regionserver.HStore(1912): 6638aa08a24bc6e34e9840c49e638c8a/family1 is initiating major compaction (all files) 2023-11-13 04:55:13,370 INFO [Listener at localhost/34517] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-13 04:55:13,370 INFO [Listener at localhost/34517] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-13 04:55:13,371 INFO [Listener at localhost/34517] regionserver.HRegion(2259): Starting compaction of 6638aa08a24bc6e34e9840c49e638c8a/family1 in testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a. 2023-11-13 04:55:13,371 INFO [Listener at localhost/34517] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/12c93e792bf84957ac292148d77afa10, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/4a4345fbfaf544a4bca8220aa5491d91, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/9db28e991279470d84afb14894901a51, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/08fde853956a475e89743233b5800da0, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/260526dd65b6451bac5f04fb8f3d5251] into tmpdir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/.tmp, totalSize=26.7 K 2023-11-13 04:55:13,371 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 12c93e792bf84957ac292148d77afa10, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699851302515 2023-11-13 04:55:13,372 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 4a4345fbfaf544a4bca8220aa5491d91, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699851304294 2023-11-13 04:55:13,372 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 9db28e991279470d84afb14894901a51, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699851306113 2023-11-13 04:55:13,373 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 08fde853956a475e89743233b5800da0, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699851307908 2023-11-13 04:55:13,373 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 260526dd65b6451bac5f04fb8f3d5251, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-13 04:55:13,387 INFO [Listener at localhost/34517] throttle.PressureAwareThroughputController(145): 6638aa08a24bc6e34e9840c49e638c8a#family1#compaction#107 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-13 04:55:13,406 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202311138fc36a0380d1462f99bd40a416e7dbb9_del 2023-11-13 04:55:13,407 INFO [Listener at localhost/34517] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311138fc36a0380d1462f99bd40a416e7dbb9_del to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311138fc36a0380d1462f99bd40a416e7dbb9_del 2023-11-13 04:55:13,431 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6453bbc9b42e419d8a1844a5f14796d7 2023-11-13 04:55:13,432 DEBUG [Listener at localhost/34517] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/.tmp/family1/6453bbc9b42e419d8a1844a5f14796d7 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/6453bbc9b42e419d8a1844a5f14796d7 2023-11-13 04:55:13,435 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6453bbc9b42e419d8a1844a5f14796d7 2023-11-13 04:55:13,436 INFO [Listener at localhost/34517] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 6638aa08a24bc6e34e9840c49e638c8a/family1 of 6638aa08a24bc6e34e9840c49e638c8a into 6453bbc9b42e419d8a1844a5f14796d7(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-13 04:55:13,436 DEBUG [Listener at localhost/34517] regionserver.HRegion(2289): Compaction status journal for 6638aa08a24bc6e34e9840c49e638c8a: 2023-11-13 04:55:13,436 DEBUG [Listener at localhost/34517] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-13 04:55:13,436 DEBUG [Listener at localhost/34517] regionserver.HStore(1912): 6638aa08a24bc6e34e9840c49e638c8a/family2 is initiating major compaction (all files) 2023-11-13 04:55:13,437 INFO [Listener at localhost/34517] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-13 04:55:13,437 INFO [Listener at localhost/34517] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-13 04:55:13,437 INFO [Listener at localhost/34517] regionserver.HRegion(2259): Starting compaction of 6638aa08a24bc6e34e9840c49e638c8a/family2 in testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a. 2023-11-13 04:55:13,437 INFO [Listener at localhost/34517] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/86886665116d4ba293a13c09aedad26a, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/3a385363c38c493db398a3eeb8c23c45, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/9e729fa6d311473c96c179090d6b8367, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/f6fb49bb4ab442b39a424a889d8ab93e, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/ec46faa226d64a418d726ea828fcdab3] into tmpdir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/.tmp, totalSize=25.4 K 2023-11-13 04:55:13,437 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 86886665116d4ba293a13c09aedad26a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699851302515 2023-11-13 04:55:13,438 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 3a385363c38c493db398a3eeb8c23c45, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699851304294 2023-11-13 04:55:13,438 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 9e729fa6d311473c96c179090d6b8367, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699851306113 2023-11-13 04:55:13,438 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting f6fb49bb4ab442b39a424a889d8ab93e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699851307908 2023-11-13 04:55:13,439 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting ec46faa226d64a418d726ea828fcdab3, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-13 04:55:13,461 INFO [Listener at localhost/34517] throttle.PressureAwareThroughputController(145): 6638aa08a24bc6e34e9840c49e638c8a#family2#compaction#108 average throughput is 0.13 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-13 04:55:13,519 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/12c93e792bf84957ac292148d77afa10, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/4a4345fbfaf544a4bca8220aa5491d91, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/9db28e991279470d84afb14894901a51, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/08fde853956a475e89743233b5800da0, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/260526dd65b6451bac5f04fb8f3d5251] to archive 2023-11-13 04:55:13,520 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:55:13,522 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/12c93e792bf84957ac292148d77afa10 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/12c93e792bf84957ac292148d77afa10 2023-11-13 04:55:13,523 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/4a4345fbfaf544a4bca8220aa5491d91 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/4a4345fbfaf544a4bca8220aa5491d91 2023-11-13 04:55:13,524 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/9db28e991279470d84afb14894901a51 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/9db28e991279470d84afb14894901a51 2023-11-13 04:55:13,525 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/08fde853956a475e89743233b5800da0 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/08fde853956a475e89743233b5800da0 2023-11-13 04:55:13,526 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/260526dd65b6451bac5f04fb8f3d5251 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/260526dd65b6451bac5f04fb8f3d5251 2023-11-13 04:55:13,876 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202311131d816f9718ba450b8d3af53327a04889_del 2023-11-13 04:55:13,877 INFO [Listener at localhost/34517] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311131d816f9718ba450b8d3af53327a04889_del to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311131d816f9718ba450b8d3af53327a04889_del 2023-11-13 04:55:14,693 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c8367a051edc468f8a0c18a9bdf76e08 2023-11-13 04:55:14,694 DEBUG [Listener at localhost/34517] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/.tmp/family2/c8367a051edc468f8a0c18a9bdf76e08 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/c8367a051edc468f8a0c18a9bdf76e08 2023-11-13 04:55:14,698 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c8367a051edc468f8a0c18a9bdf76e08 2023-11-13 04:55:14,699 INFO [Listener at localhost/34517] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 6638aa08a24bc6e34e9840c49e638c8a/family2 of 6638aa08a24bc6e34e9840c49e638c8a into c8367a051edc468f8a0c18a9bdf76e08(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-13 04:55:14,699 DEBUG [Listener at localhost/34517] regionserver.HRegion(2289): Compaction status journal for 6638aa08a24bc6e34e9840c49e638c8a: 2023-11-13 04:55:14,700 DEBUG [Listener at localhost/34517] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-13 04:55:14,700 DEBUG [Listener at localhost/34517] regionserver.HStore(1912): bfeed2e88ce202cf921374d6d67968c7/family1 is initiating major compaction (all files) 2023-11-13 04:55:14,700 INFO [Listener at localhost/34517] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-13 04:55:14,700 INFO [Listener at localhost/34517] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-13 04:55:14,700 INFO [Listener at localhost/34517] regionserver.HRegion(2259): Starting compaction of bfeed2e88ce202cf921374d6d67968c7/family1 in testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7. 2023-11-13 04:55:14,700 INFO [Listener at localhost/34517] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/fccd59c304254894860a914ea6db14f2, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/c5987b1cd73845f98c8edc455ccf47dc, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/2990516ad7cc46d3b9e125f204a3056a, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/7fb2b16fcf754db5864380917a8c5ea9, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/44e40cd075184923af060f62c744bb1d] into tmpdir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/.tmp, totalSize=26.7 K 2023-11-13 04:55:14,701 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting fccd59c304254894860a914ea6db14f2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699851302516 2023-11-13 04:55:14,701 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting c5987b1cd73845f98c8edc455ccf47dc, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699851304295 2023-11-13 04:55:14,702 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 2990516ad7cc46d3b9e125f204a3056a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699851306114 2023-11-13 04:55:14,702 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 7fb2b16fcf754db5864380917a8c5ea9, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699851307908 2023-11-13 04:55:14,703 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 44e40cd075184923af060f62c744bb1d, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-13 04:55:14,719 INFO [Listener at localhost/34517] throttle.PressureAwareThroughputController(145): bfeed2e88ce202cf921374d6d67968c7#family1#compaction#109 average throughput is 0.24 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-13 04:55:14,722 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/86886665116d4ba293a13c09aedad26a, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/3a385363c38c493db398a3eeb8c23c45, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/9e729fa6d311473c96c179090d6b8367, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/f6fb49bb4ab442b39a424a889d8ab93e, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/ec46faa226d64a418d726ea828fcdab3] to archive 2023-11-13 04:55:14,723 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:55:14,724 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/86886665116d4ba293a13c09aedad26a to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/86886665116d4ba293a13c09aedad26a 2023-11-13 04:55:14,726 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/3a385363c38c493db398a3eeb8c23c45 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/3a385363c38c493db398a3eeb8c23c45 2023-11-13 04:55:14,727 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/9e729fa6d311473c96c179090d6b8367 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/9e729fa6d311473c96c179090d6b8367 2023-11-13 04:55:14,728 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/f6fb49bb4ab442b39a424a889d8ab93e to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/f6fb49bb4ab442b39a424a889d8ab93e 2023-11-13 04:55:14,730 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/ec46faa226d64a418d726ea828fcdab3 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/ec46faa226d64a418d726ea828fcdab3 2023-11-13 04:55:15,143 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023111399de8ac768cb4ef8b5b8add19da434ac_del 2023-11-13 04:55:15,143 INFO [Listener at localhost/34517] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111399de8ac768cb4ef8b5b8add19da434ac_del to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023111399de8ac768cb4ef8b5b8add19da434ac_del 2023-11-13 04:55:15,958 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4e0dbdd1cb8746f8ace4ce666be37ecd 2023-11-13 04:55:15,959 DEBUG [Listener at localhost/34517] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/.tmp/family1/4e0dbdd1cb8746f8ace4ce666be37ecd as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/4e0dbdd1cb8746f8ace4ce666be37ecd 2023-11-13 04:55:15,963 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4e0dbdd1cb8746f8ace4ce666be37ecd 2023-11-13 04:55:15,964 INFO [Listener at localhost/34517] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in bfeed2e88ce202cf921374d6d67968c7/family1 of bfeed2e88ce202cf921374d6d67968c7 into 4e0dbdd1cb8746f8ace4ce666be37ecd(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-13 04:55:15,964 DEBUG [Listener at localhost/34517] regionserver.HRegion(2289): Compaction status journal for bfeed2e88ce202cf921374d6d67968c7: 2023-11-13 04:55:15,964 DEBUG [Listener at localhost/34517] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-13 04:55:15,964 DEBUG [Listener at localhost/34517] regionserver.HStore(1912): bfeed2e88ce202cf921374d6d67968c7/family2 is initiating major compaction (all files) 2023-11-13 04:55:15,964 INFO [Listener at localhost/34517] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-13 04:55:15,964 INFO [Listener at localhost/34517] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-13 04:55:15,964 INFO [Listener at localhost/34517] regionserver.HRegion(2259): Starting compaction of bfeed2e88ce202cf921374d6d67968c7/family2 in testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7. 2023-11-13 04:55:15,965 INFO [Listener at localhost/34517] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/8f39ca4d1f2047799898b9eb81767fb1, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/46c6c9a3dbd045e8a34a53ced1c80592, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/ed2295265451475b90c1bdcd90481da6, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/c6aa2bd8bb014b1a9a42a050ee5af1d6, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/e44c778128c94befaff591612975c2be] into tmpdir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/.tmp, totalSize=25.4 K 2023-11-13 04:55:15,965 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 8f39ca4d1f2047799898b9eb81767fb1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699851302516 2023-11-13 04:55:15,965 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 46c6c9a3dbd045e8a34a53ced1c80592, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699851304295 2023-11-13 04:55:15,966 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting ed2295265451475b90c1bdcd90481da6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699851306114 2023-11-13 04:55:15,966 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting c6aa2bd8bb014b1a9a42a050ee5af1d6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699851307908 2023-11-13 04:55:15,966 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting e44c778128c94befaff591612975c2be, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-13 04:55:15,977 INFO [Listener at localhost/34517] throttle.PressureAwareThroughputController(145): bfeed2e88ce202cf921374d6d67968c7#family2#compaction#110 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-13 04:55:16,018 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/fccd59c304254894860a914ea6db14f2, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/c5987b1cd73845f98c8edc455ccf47dc, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/2990516ad7cc46d3b9e125f204a3056a, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/7fb2b16fcf754db5864380917a8c5ea9, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/44e40cd075184923af060f62c744bb1d] to archive 2023-11-13 04:55:16,019 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:55:16,020 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/fccd59c304254894860a914ea6db14f2 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/fccd59c304254894860a914ea6db14f2 2023-11-13 04:55:16,021 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/c5987b1cd73845f98c8edc455ccf47dc to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/c5987b1cd73845f98c8edc455ccf47dc 2023-11-13 04:55:16,022 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/2990516ad7cc46d3b9e125f204a3056a to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/2990516ad7cc46d3b9e125f204a3056a 2023-11-13 04:55:16,023 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/7fb2b16fcf754db5864380917a8c5ea9 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/7fb2b16fcf754db5864380917a8c5ea9 2023-11-13 04:55:16,024 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/44e40cd075184923af060f62c744bb1d to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/44e40cd075184923af060f62c744bb1d 2023-11-13 04:55:16,386 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311134506f21f51864a8a81a5e9e3cd72c05e_del 2023-11-13 04:55:16,386 INFO [Listener at localhost/34517] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311134506f21f51864a8a81a5e9e3cd72c05e_del to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311134506f21f51864a8a81a5e9e3cd72c05e_del 2023-11-13 04:55:17,214 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dac2b42da66b4ca985cee8d97740757f 2023-11-13 04:55:17,215 DEBUG [Listener at localhost/34517] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/.tmp/family2/dac2b42da66b4ca985cee8d97740757f as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/dac2b42da66b4ca985cee8d97740757f 2023-11-13 04:55:17,219 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dac2b42da66b4ca985cee8d97740757f 2023-11-13 04:55:17,220 INFO [Listener at localhost/34517] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in bfeed2e88ce202cf921374d6d67968c7/family2 of bfeed2e88ce202cf921374d6d67968c7 into dac2b42da66b4ca985cee8d97740757f(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-13 04:55:17,220 DEBUG [Listener at localhost/34517] regionserver.HRegion(2289): Compaction status journal for bfeed2e88ce202cf921374d6d67968c7: 2023-11-13 04:55:17,221 DEBUG [Listener at localhost/34517] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-13 04:55:17,221 DEBUG [Listener at localhost/34517] regionserver.HStore(1912): e13efa47a2338bfc8c25006e697a36d8/family1 is initiating major compaction (all files) 2023-11-13 04:55:17,221 INFO [Listener at localhost/34517] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-13 04:55:17,221 INFO [Listener at localhost/34517] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-13 04:55:17,221 INFO [Listener at localhost/34517] regionserver.HRegion(2259): Starting compaction of e13efa47a2338bfc8c25006e697a36d8/family1 in testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8. 2023-11-13 04:55:17,221 INFO [Listener at localhost/34517] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/390824bbfce04fd9ac1b935a17760523, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/2ea41d0a5fc141e4ad3d775a051b52a4, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/4e0fe736e59d4ea9950d123020a08137, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/0b548a931acb440487d096ffaf5c6b41, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/dfdc95ebf1a0451ca961aae7201a3296] into tmpdir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/.tmp, totalSize=26.7 K 2023-11-13 04:55:17,222 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 390824bbfce04fd9ac1b935a17760523, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699851302514 2023-11-13 04:55:17,222 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 2ea41d0a5fc141e4ad3d775a051b52a4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699851304294 2023-11-13 04:55:17,223 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 4e0fe736e59d4ea9950d123020a08137, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699851306113 2023-11-13 04:55:17,223 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 0b548a931acb440487d096ffaf5c6b41, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699851307908 2023-11-13 04:55:17,223 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting dfdc95ebf1a0451ca961aae7201a3296, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-13 04:55:17,237 INFO [Listener at localhost/34517] throttle.PressureAwareThroughputController(145): e13efa47a2338bfc8c25006e697a36d8#family1#compaction#111 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-13 04:55:17,319 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/8f39ca4d1f2047799898b9eb81767fb1, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/46c6c9a3dbd045e8a34a53ced1c80592, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/ed2295265451475b90c1bdcd90481da6, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/c6aa2bd8bb014b1a9a42a050ee5af1d6, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/e44c778128c94befaff591612975c2be] to archive 2023-11-13 04:55:17,320 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:55:17,322 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/8f39ca4d1f2047799898b9eb81767fb1 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/8f39ca4d1f2047799898b9eb81767fb1 2023-11-13 04:55:17,323 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/46c6c9a3dbd045e8a34a53ced1c80592 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/46c6c9a3dbd045e8a34a53ced1c80592 2023-11-13 04:55:17,325 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/ed2295265451475b90c1bdcd90481da6 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/ed2295265451475b90c1bdcd90481da6 2023-11-13 04:55:17,326 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/c6aa2bd8bb014b1a9a42a050ee5af1d6 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/c6aa2bd8bb014b1a9a42a050ee5af1d6 2023-11-13 04:55:17,327 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/e44c778128c94befaff591612975c2be to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/e44c778128c94befaff591612975c2be 2023-11-13 04:55:17,648 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231113a30a9d0fd1c341edac6d8f75485bee2e_del 2023-11-13 04:55:17,648 INFO [Listener at localhost/34517] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231113a30a9d0fd1c341edac6d8f75485bee2e_del to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231113a30a9d0fd1c341edac6d8f75485bee2e_del 2023-11-13 04:55:18,462 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 69352c43322746319229d6cb86dc39a4 2023-11-13 04:55:18,463 DEBUG [Listener at localhost/34517] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/.tmp/family1/69352c43322746319229d6cb86dc39a4 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/69352c43322746319229d6cb86dc39a4 2023-11-13 04:55:18,468 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 69352c43322746319229d6cb86dc39a4 2023-11-13 04:55:18,469 INFO [Listener at localhost/34517] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in e13efa47a2338bfc8c25006e697a36d8/family1 of e13efa47a2338bfc8c25006e697a36d8 into 69352c43322746319229d6cb86dc39a4(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-13 04:55:18,469 DEBUG [Listener at localhost/34517] regionserver.HRegion(2289): Compaction status journal for e13efa47a2338bfc8c25006e697a36d8: 2023-11-13 04:55:18,469 DEBUG [Listener at localhost/34517] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-13 04:55:18,470 DEBUG [Listener at localhost/34517] regionserver.HStore(1912): e13efa47a2338bfc8c25006e697a36d8/family2 is initiating major compaction (all files) 2023-11-13 04:55:18,470 INFO [Listener at localhost/34517] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-13 04:55:18,470 INFO [Listener at localhost/34517] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-13 04:55:18,471 INFO [Listener at localhost/34517] regionserver.HRegion(2259): Starting compaction of e13efa47a2338bfc8c25006e697a36d8/family2 in testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8. 2023-11-13 04:55:18,471 INFO [Listener at localhost/34517] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/425709ac686d4a6599e4146cbc4e1457, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/719456a418b4436fa26acb297228e658, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/52d64f3aa1c842828ad355d41c232a9a, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/d7c4c89b37e547b6a119da3fe0471bf1, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/9965648b95854ca2a3c70b8e401b86c1] into tmpdir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/.tmp, totalSize=25.4 K 2023-11-13 04:55:18,471 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 425709ac686d4a6599e4146cbc4e1457, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699851302514 2023-11-13 04:55:18,472 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 719456a418b4436fa26acb297228e658, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699851304294 2023-11-13 04:55:18,472 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 52d64f3aa1c842828ad355d41c232a9a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699851306113 2023-11-13 04:55:18,472 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting d7c4c89b37e547b6a119da3fe0471bf1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699851307908 2023-11-13 04:55:18,473 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 9965648b95854ca2a3c70b8e401b86c1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-13 04:55:18,485 INFO [Listener at localhost/34517] throttle.PressureAwareThroughputController(145): e13efa47a2338bfc8c25006e697a36d8#family2#compaction#112 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-13 04:55:18,515 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/390824bbfce04fd9ac1b935a17760523, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/2ea41d0a5fc141e4ad3d775a051b52a4, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/4e0fe736e59d4ea9950d123020a08137, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/0b548a931acb440487d096ffaf5c6b41, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/dfdc95ebf1a0451ca961aae7201a3296] to archive 2023-11-13 04:55:18,515 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:55:18,517 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/390824bbfce04fd9ac1b935a17760523 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/390824bbfce04fd9ac1b935a17760523 2023-11-13 04:55:18,518 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/2ea41d0a5fc141e4ad3d775a051b52a4 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/2ea41d0a5fc141e4ad3d775a051b52a4 2023-11-13 04:55:18,519 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/4e0fe736e59d4ea9950d123020a08137 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/4e0fe736e59d4ea9950d123020a08137 2023-11-13 04:55:18,520 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/0b548a931acb440487d096ffaf5c6b41 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/0b548a931acb440487d096ffaf5c6b41 2023-11-13 04:55:18,521 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/dfdc95ebf1a0451ca961aae7201a3296 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/dfdc95ebf1a0451ca961aae7201a3296 2023-11-13 04:55:18,893 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231113ffb3b7a04e354ec2b4c8e35111de3f82_del 2023-11-13 04:55:18,893 INFO [Listener at localhost/34517] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231113ffb3b7a04e354ec2b4c8e35111de3f82_del to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231113ffb3b7a04e354ec2b4c8e35111de3f82_del 2023-11-13 04:55:19,708 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 64bb6b42c66c47b1a0fa7dd14a636354 2023-11-13 04:55:19,709 DEBUG [Listener at localhost/34517] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/.tmp/family2/64bb6b42c66c47b1a0fa7dd14a636354 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/64bb6b42c66c47b1a0fa7dd14a636354 2023-11-13 04:55:19,713 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 64bb6b42c66c47b1a0fa7dd14a636354 2023-11-13 04:55:19,714 INFO [Listener at localhost/34517] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in e13efa47a2338bfc8c25006e697a36d8/family2 of e13efa47a2338bfc8c25006e697a36d8 into 64bb6b42c66c47b1a0fa7dd14a636354(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-13 04:55:19,714 DEBUG [Listener at localhost/34517] regionserver.HRegion(2289): Compaction status journal for e13efa47a2338bfc8c25006e697a36d8: 2023-11-13 04:55:19,714 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/425709ac686d4a6599e4146cbc4e1457, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/719456a418b4436fa26acb297228e658, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/52d64f3aa1c842828ad355d41c232a9a, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/d7c4c89b37e547b6a119da3fe0471bf1, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/9965648b95854ca2a3c70b8e401b86c1] to archive 2023-11-13 04:55:19,716 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:55:19,719 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/425709ac686d4a6599e4146cbc4e1457 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/425709ac686d4a6599e4146cbc4e1457 2023-11-13 04:55:19,719 DEBUG [Listener at localhost/34517] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-13 04:55:19,721 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/719456a418b4436fa26acb297228e658 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/719456a418b4436fa26acb297228e658 2023-11-13 04:55:19,723 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/52d64f3aa1c842828ad355d41c232a9a to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/52d64f3aa1c842828ad355d41c232a9a 2023-11-13 04:55:19,724 DEBUG [Listener at localhost/34517] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-13 04:55:19,724 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/d7c4c89b37e547b6a119da3fe0471bf1 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/d7c4c89b37e547b6a119da3fe0471bf1 2023-11-13 04:55:19,726 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/9965648b95854ca2a3c70b8e401b86c1 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/9965648b95854ca2a3c70b8e401b86c1 2023-11-13 04:55:19,736 DEBUG [Listener at localhost/34517] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-13 04:55:19,737 DEBUG [Listener at localhost/34517] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-13 04:55:19,744 INFO [Listener at localhost/34517] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-13 04:55:19,780 INFO [Listener at localhost/34517] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-11-13 04:55:19,784 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231113a30a9d0fd1c341edac6d8f75485bee2e_del 2023-11-13 04:55:19,787 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202311138fc36a0380d1462f99bd40a416e7dbb9_del 2023-11-13 04:55:19,790 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023111399de8ac768cb4ef8b5b8add19da434ac_del 2023-11-13 04:55:19,790 INFO [Listener at localhost/34517] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-11-13 04:55:19,791 DEBUG [Listener at localhost/34517] zookeeper.ReadOnlyZKClient(139): Connect 0x3686646a to 127.0.0.1:51072 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-13 04:55:19,797 DEBUG [Listener at localhost/34517] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f2c20f9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-13 04:55:19,797 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231113 for table='testCompactionWithHFileLink' and column='family1' 2023-11-13 04:55:19,797 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231113 for table='testCompactionWithHFileLink' and column='family1' 2023-11-13 04:55:19,797 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231113 for table='testCompactionWithHFileLink' and column='family1' 2023-11-13 04:55:20,266 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311130dcea92e7e474b75ae0efeb8b13e4bd7 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311130dcea92e7e474b75ae0efeb8b13e4bd7 2023-11-13 04:55:20,267 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231113 table='testCompactionWithHFileLink' column='family1' 2023-11-13 04:55:20,274 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311134482cd522a6241eca7fc4ce5e0495677 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311134482cd522a6241eca7fc4ce5e0495677 2023-11-13 04:55:20,274 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231113 table='testCompactionWithHFileLink' column='family1' 2023-11-13 04:55:20,281 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-13 04:55:20,284 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37084, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-13 04:55:20,291 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-13 04:55:20,292 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37758, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-13 04:55:20,301 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231113/family1/43b1d58faabe4c08aef54e603b53389d first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-11-13 04:55:20,301 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231113/family1/7a3df082d9994166b5e35b1364a384db first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-11-13 04:55:20,303 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7., hostname=jenkins-hbase4.apache.org,41657,1699851201532, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231113/family1/43b1d58faabe4c08aef54e603b53389d}] 2023-11-13 04:55:20,303 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8., hostname=jenkins-hbase4.apache.org,41657,1699851201532, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231113/family1/7a3df082d9994166b5e35b1364a384db}] 2023-11-13 04:55:20,309 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(763): Validating hfile at hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231113/family1/43b1d58faabe4c08aef54e603b53389d for inclusion in bfeed2e88ce202cf921374d6d67968c7/family1 2023-11-13 04:55:20,309 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(763): Validating hfile at hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231113/family1/7a3df082d9994166b5e35b1364a384db for inclusion in e13efa47a2338bfc8c25006e697a36d8/family1 2023-11-13 04:55:20,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-11-13 04:55:20,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-13 04:55:20,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HRegion(2446): Flush status journal for bfeed2e88ce202cf921374d6d67968c7: 2023-11-13 04:55:20,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-11-13 04:55:20,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(777): Region bounds: first= last=1 2023-11-13 04:55:20,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HRegion(2446): Flush status journal for e13efa47a2338bfc8c25006e697a36d8: 2023-11-13 04:55:20,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231113/family1/43b1d58faabe4c08aef54e603b53389d to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testCompactionWithHFileLink__t2tmfht0qm964a4m2t7u287dn058581nrnkqud8d3u53s2s95sd1l8foiecb54c4/family1/43b1d58faabe4c08aef54e603b53389d 2023-11-13 04:55:20,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231113/family1/7a3df082d9994166b5e35b1364a384db to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testCompactionWithHFileLink__3gqsc32rsooqime7irdsaektaru2ig9e8btbjg432hdcv514t1m8nbtbq2qc09q0/family1/7a3df082d9994166b5e35b1364a384db 2023-11-13 04:55:20,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testCompactionWithHFileLink__t2tmfht0qm964a4m2t7u287dn058581nrnkqud8d3u53s2s95sd1l8foiecb54c4/family1/43b1d58faabe4c08aef54e603b53389d as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/95a804284b0243899f40bf451f9f1603_SeqId_29_ 2023-11-13 04:55:20,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testCompactionWithHFileLink__3gqsc32rsooqime7irdsaektaru2ig9e8btbjg432hdcv514t1m8nbtbq2qc09q0/family1/7a3df082d9994166b5e35b1364a384db as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/9230653438bf4c04a425d3556cf437f2_SeqId_29_ 2023-11-13 04:55:20,315 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(849): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testCompactionWithHFileLink__t2tmfht0qm964a4m2t7u287dn058581nrnkqud8d3u53s2s95sd1l8foiecb54c4/family1/43b1d58faabe4c08aef54e603b53389d into bfeed2e88ce202cf921374d6d67968c7/family1 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/95a804284b0243899f40bf451f9f1603_SeqId_29_ - updating store file list. 2023-11-13 04:55:20,315 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(849): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testCompactionWithHFileLink__3gqsc32rsooqime7irdsaektaru2ig9e8btbjg432hdcv514t1m8nbtbq2qc09q0/family1/7a3df082d9994166b5e35b1364a384db into e13efa47a2338bfc8c25006e697a36d8/family1 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/9230653438bf4c04a425d3556cf437f2_SeqId_29_ - updating store file list. 2023-11-13 04:55:20,319 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(882): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/95a804284b0243899f40bf451f9f1603_SeqId_29_ into bfeed2e88ce202cf921374d6d67968c7/family1 2023-11-13 04:55:20,319 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(855): Successfully loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testCompactionWithHFileLink__t2tmfht0qm964a4m2t7u287dn058581nrnkqud8d3u53s2s95sd1l8foiecb54c4/family1/43b1d58faabe4c08aef54e603b53389d into bfeed2e88ce202cf921374d6d67968c7/family1 (new location: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/95a804284b0243899f40bf451f9f1603_SeqId_29_) 2023-11-13 04:55:20,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testCompactionWithHFileLink__t2tmfht0qm964a4m2t7u287dn058581nrnkqud8d3u53s2s95sd1l8foiecb54c4/family1/43b1d58faabe4c08aef54e603b53389d 2023-11-13 04:55:20,320 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(882): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/9230653438bf4c04a425d3556cf437f2_SeqId_29_ into e13efa47a2338bfc8c25006e697a36d8/family1 2023-11-13 04:55:20,320 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(855): Successfully loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testCompactionWithHFileLink__3gqsc32rsooqime7irdsaektaru2ig9e8btbjg432hdcv514t1m8nbtbq2qc09q0/family1/7a3df082d9994166b5e35b1364a384db into e13efa47a2338bfc8c25006e697a36d8/family1 (new location: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/9230653438bf4c04a425d3556cf437f2_SeqId_29_) 2023-11-13 04:55:20,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testCompactionWithHFileLink__3gqsc32rsooqime7irdsaektaru2ig9e8btbjg432hdcv514t1m8nbtbq2qc09q0/family1/7a3df082d9994166b5e35b1364a384db 2023-11-13 04:55:20,322 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231113 table='testCompactionWithHFileLink' column='family1' 2023-11-13 04:55:20,323 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:55:20,325 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023111365f56168a30e4de6aa4908b7a0069dc8 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023111365f56168a30e4de6aa4908b7a0069dc8 2023-11-13 04:55:20,325 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231113 table='testCompactionWithHFileLink' column='family1' 2023-11-13 04:55:20,325 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:55:20,326 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023111378016b094e234a4386415dae4a14c642 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023111378016b094e234a4386415dae4a14c642 2023-11-13 04:55:20,327 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311137b3eadda4c934e8f9d523657a0b77183 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311137b3eadda4c934e8f9d523657a0b77183 2023-11-13 04:55:20,327 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023111382d6195e776e49da80fb040337f6e2f1 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023111382d6195e776e49da80fb040337f6e2f1 2023-11-13 04:55:20,328 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231113a253e2457d5f435ebee6f1ee36f55d25 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231113a253e2457d5f435ebee6f1ee36f55d25 2023-11-13 04:55:20,328 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311138a7e2bf3f47841619b334d10c3ce3fd4 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311138a7e2bf3f47841619b334d10c3ce3fd4 2023-11-13 04:55:20,328 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-13 04:55:20,328 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231113' 2023-11-13 04:55:20,328 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231113 for table='testCompactionWithHFileLink' and column='family1' 2023-11-13 04:55:20,329 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231113dd59155911b448159fdd1cef1c0b1083 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231113dd59155911b448159fdd1cef1c0b1083 2023-11-13 04:55:20,330 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231113f6671f6d9d62429f971e5c2dd1292622 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231113f6671f6d9d62429f971e5c2dd1292622 2023-11-13 04:55:20,330 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-13 04:55:20,330 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231113' 2023-11-13 04:55:20,330 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231113 for table='testCompactionWithHFileLink' and column='family1' 2023-11-13 04:55:20,670 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231113c12b904a29844a06a2ecc381ad5fb84f to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231113c12b904a29844a06a2ecc381ad5fb84f 2023-11-13 04:55:20,671 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231113 table='testCompactionWithHFileLink' column='family1' 2023-11-13 04:55:20,696 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231113/family1/39136a8e131a4778b3f1f7202aeac9de first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-11-13 04:55:20,696 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a., hostname=jenkins-hbase4.apache.org,41657,1699851201532, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231113/family1/39136a8e131a4778b3f1f7202aeac9de}] 2023-11-13 04:55:20,698 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(763): Validating hfile at hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231113/family1/39136a8e131a4778b3f1f7202aeac9de for inclusion in 6638aa08a24bc6e34e9840c49e638c8a/family1 2023-11-13 04:55:20,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-11-13 04:55:20,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-13 04:55:20,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HRegion(2446): Flush status journal for 6638aa08a24bc6e34e9840c49e638c8a: 2023-11-13 04:55:20,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231113/family1/39136a8e131a4778b3f1f7202aeac9de to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testCompactionWithHFileLink__o71c8o5jd9a70bc1ufk94t1l468jgmnvmn1etal66lcbbn35fujmgr2ch785u6bq/family1/39136a8e131a4778b3f1f7202aeac9de 2023-11-13 04:55:20,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testCompactionWithHFileLink__o71c8o5jd9a70bc1ufk94t1l468jgmnvmn1etal66lcbbn35fujmgr2ch785u6bq/family1/39136a8e131a4778b3f1f7202aeac9de as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/c2900e5cf99f4354acf8024b75dee44e_SeqId_29_ 2023-11-13 04:55:20,705 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(849): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testCompactionWithHFileLink__o71c8o5jd9a70bc1ufk94t1l468jgmnvmn1etal66lcbbn35fujmgr2ch785u6bq/family1/39136a8e131a4778b3f1f7202aeac9de into 6638aa08a24bc6e34e9840c49e638c8a/family1 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/c2900e5cf99f4354acf8024b75dee44e_SeqId_29_ - updating store file list. 2023-11-13 04:55:20,708 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(882): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/c2900e5cf99f4354acf8024b75dee44e_SeqId_29_ into 6638aa08a24bc6e34e9840c49e638c8a/family1 2023-11-13 04:55:20,708 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(855): Successfully loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testCompactionWithHFileLink__o71c8o5jd9a70bc1ufk94t1l468jgmnvmn1etal66lcbbn35fujmgr2ch785u6bq/family1/39136a8e131a4778b3f1f7202aeac9de into 6638aa08a24bc6e34e9840c49e638c8a/family1 (new location: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/c2900e5cf99f4354acf8024b75dee44e_SeqId_29_) 2023-11-13 04:55:20,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testCompactionWithHFileLink__o71c8o5jd9a70bc1ufk94t1l468jgmnvmn1etal66lcbbn35fujmgr2ch785u6bq/family1/39136a8e131a4778b3f1f7202aeac9de 2023-11-13 04:55:20,710 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231113 table='testCompactionWithHFileLink' column='family1' 2023-11-13 04:55:20,711 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:55:20,712 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023111343a962cdb9454855b1cba6892085e038 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023111343a962cdb9454855b1cba6892085e038 2023-11-13 04:55:20,713 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231113a01b6cba5f564864bf45c965c8cd4871 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231113a01b6cba5f564864bf45c965c8cd4871 2023-11-13 04:55:20,714 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231113c7bb0d4adb7e47fa816b3246d1d1523e to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231113c7bb0d4adb7e47fa816b3246d1d1523e 2023-11-13 04:55:20,715 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231113f2f4bd37329a480bbfee9819afebc9a3 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231113f2f4bd37329a480bbfee9819afebc9a3 2023-11-13 04:55:20,715 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-13 04:55:20,715 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231113' 2023-11-13 04:55:20,716 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231113 for table='testCompactionWithHFileLink' and column='family1' 2023-11-13 04:55:20,716 INFO [Listener at localhost/34517] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-11-13 04:55:20,716 INFO [Listener at localhost/34517] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-11-13 04:55:20,716 INFO [Listener at localhost/34517] compactions.PartitionedMobCompactor(367): [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231113a30a9d0fd1c341edac6d8f75485bee2e_del] 2023-11-13 04:55:20,717 DEBUG [Listener at localhost/34517] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:55:20,718 DEBUG [Listener at localhost/34517] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231113a30a9d0fd1c341edac6d8f75485bee2e_del to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231113a30a9d0fd1c341edac6d8f75485bee2e_del 2023-11-13 04:55:20,718 INFO [Listener at localhost/34517] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-13 04:55:20,718 INFO [Listener at localhost/34517] compactions.PartitionedMobCompactor(367): [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311138fc36a0380d1462f99bd40a416e7dbb9_del] 2023-11-13 04:55:20,719 DEBUG [Listener at localhost/34517] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:55:20,720 DEBUG [Listener at localhost/34517] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311138fc36a0380d1462f99bd40a416e7dbb9_del to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311138fc36a0380d1462f99bd40a416e7dbb9_del 2023-11-13 04:55:20,720 INFO [Listener at localhost/34517] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-13 04:55:20,720 INFO [Listener at localhost/34517] compactions.PartitionedMobCompactor(367): [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023111399de8ac768cb4ef8b5b8add19da434ac_del] 2023-11-13 04:55:20,720 DEBUG [Listener at localhost/34517] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:55:20,722 DEBUG [Listener at localhost/34517] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023111399de8ac768cb4ef8b5b8add19da434ac_del to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023111399de8ac768cb4ef8b5b8add19da434ac_del 2023-11-13 04:55:20,722 INFO [Listener at localhost/34517] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-13 04:55:20,724 DEBUG [Listener at localhost/34517] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-13 04:55:20,726 DEBUG [Listener at localhost/34517] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-13 04:55:20,729 DEBUG [Listener at localhost/34517] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-13 04:55:20,730 DEBUG [Listener at localhost/34517] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-13 04:55:20,736 INFO [Listener at localhost/34517] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-11-13 04:55:20,736 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testCompactionWithHFileLink 2023-11-13 04:55:20,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure2.ProcedureExecutor(1028): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-11-13 04:55:20,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-13 04:55:20,739 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699851320739"}]},"ts":"1699851320739"} 2023-11-13 04:55:20,740 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-11-13 04:55:20,741 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-11-13 04:55:20,742 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=e13efa47a2338bfc8c25006e697a36d8, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=6638aa08a24bc6e34e9840c49e638c8a, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=bfeed2e88ce202cf921374d6d67968c7, UNASSIGN}] 2023-11-13 04:55:20,743 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=6638aa08a24bc6e34e9840c49e638c8a, UNASSIGN 2023-11-13 04:55:20,743 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=bfeed2e88ce202cf921374d6d67968c7, UNASSIGN 2023-11-13 04:55:20,743 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=e13efa47a2338bfc8c25006e697a36d8, UNASSIGN 2023-11-13 04:55:20,744 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=6638aa08a24bc6e34e9840c49e638c8a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:20,744 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=bfeed2e88ce202cf921374d6d67968c7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:20,744 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=e13efa47a2338bfc8c25006e697a36d8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:20,744 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699851320744"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699851320744"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699851320744"}]},"ts":"1699851320744"} 2023-11-13 04:55:20,744 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699851320744"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699851320744"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699851320744"}]},"ts":"1699851320744"} 2023-11-13 04:55:20,744 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699851320744"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699851320744"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699851320744"}]},"ts":"1699851320744"} 2023-11-13 04:55:20,745 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=92, ppid=90, state=RUNNABLE; CloseRegionProcedure 6638aa08a24bc6e34e9840c49e638c8a, server=jenkins-hbase4.apache.org,41657,1699851201532}] 2023-11-13 04:55:20,746 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; CloseRegionProcedure bfeed2e88ce202cf921374d6d67968c7, server=jenkins-hbase4.apache.org,41657,1699851201532}] 2023-11-13 04:55:20,746 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=89, state=RUNNABLE; CloseRegionProcedure e13efa47a2338bfc8c25006e697a36d8, server=jenkins-hbase4.apache.org,41657,1699851201532}] 2023-11-13 04:55:20,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-13 04:55:20,897 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:20,897 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6638aa08a24bc6e34e9840c49e638c8a 2023-11-13 04:55:20,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6638aa08a24bc6e34e9840c49e638c8a, disabling compactions & flushes 2023-11-13 04:55:20,897 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a. 2023-11-13 04:55:20,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a. 2023-11-13 04:55:20,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a. after waiting 0 ms 2023-11-13 04:55:20,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a. 2023-11-13 04:55:20,903 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-13 04:55:20,903 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a. 2023-11-13 04:55:20,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6638aa08a24bc6e34e9840c49e638c8a: 2023-11-13 04:55:20,905 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6638aa08a24bc6e34e9840c49e638c8a 2023-11-13 04:55:20,905 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close bfeed2e88ce202cf921374d6d67968c7 2023-11-13 04:55:20,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bfeed2e88ce202cf921374d6d67968c7, disabling compactions & flushes 2023-11-13 04:55:20,905 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7. 2023-11-13 04:55:20,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7. 2023-11-13 04:55:20,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7. after waiting 0 ms 2023-11-13 04:55:20,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7. 2023-11-13 04:55:20,905 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=6638aa08a24bc6e34e9840c49e638c8a, regionState=CLOSED 2023-11-13 04:55:20,905 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699851320905"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699851320905"}]},"ts":"1699851320905"} 2023-11-13 04:55:20,909 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=92, resume processing ppid=90 2023-11-13 04:55:20,909 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; CloseRegionProcedure 6638aa08a24bc6e34e9840c49e638c8a, server=jenkins-hbase4.apache.org,41657,1699851201532 in 163 msec 2023-11-13 04:55:20,910 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-13 04:55:20,910 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=6638aa08a24bc6e34e9840c49e638c8a, UNASSIGN in 167 msec 2023-11-13 04:55:20,911 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7. 2023-11-13 04:55:20,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bfeed2e88ce202cf921374d6d67968c7: 2023-11-13 04:55:20,912 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed bfeed2e88ce202cf921374d6d67968c7 2023-11-13 04:55:20,912 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e13efa47a2338bfc8c25006e697a36d8 2023-11-13 04:55:20,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e13efa47a2338bfc8c25006e697a36d8, disabling compactions & flushes 2023-11-13 04:55:20,912 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8. 2023-11-13 04:55:20,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8. 2023-11-13 04:55:20,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8. after waiting 0 ms 2023-11-13 04:55:20,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8. 2023-11-13 04:55:20,912 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=bfeed2e88ce202cf921374d6d67968c7, regionState=CLOSED 2023-11-13 04:55:20,912 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699851320912"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699851320912"}]},"ts":"1699851320912"} 2023-11-13 04:55:20,918 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=91 2023-11-13 04:55:20,918 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=91, state=SUCCESS; CloseRegionProcedure bfeed2e88ce202cf921374d6d67968c7, server=jenkins-hbase4.apache.org,41657,1699851201532 in 171 msec 2023-11-13 04:55:20,919 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=bfeed2e88ce202cf921374d6d67968c7, UNASSIGN in 176 msec 2023-11-13 04:55:20,919 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-13 04:55:20,920 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8. 2023-11-13 04:55:20,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e13efa47a2338bfc8c25006e697a36d8: 2023-11-13 04:55:20,921 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e13efa47a2338bfc8c25006e697a36d8 2023-11-13 04:55:20,921 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=e13efa47a2338bfc8c25006e697a36d8, regionState=CLOSED 2023-11-13 04:55:20,921 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699851320921"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699851320921"}]},"ts":"1699851320921"} 2023-11-13 04:55:20,923 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=89 2023-11-13 04:55:20,923 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=89, state=SUCCESS; CloseRegionProcedure e13efa47a2338bfc8c25006e697a36d8, server=jenkins-hbase4.apache.org,41657,1699851201532 in 176 msec 2023-11-13 04:55:20,924 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=89, resume processing ppid=88 2023-11-13 04:55:20,924 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=e13efa47a2338bfc8c25006e697a36d8, UNASSIGN in 181 msec 2023-11-13 04:55:20,924 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699851320924"}]},"ts":"1699851320924"} 2023-11-13 04:55:20,925 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-11-13 04:55:20,928 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-11-13 04:55:20,929 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 192 msec 2023-11-13 04:55:21,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-13 04:55:21,040 INFO [Listener at localhost/34517] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-11-13 04:55:21,052 INFO [Listener at localhost/34517] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1699851309714-1699851321052 2023-11-13 04:55:21,053 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=hbase-failsafe-snaptb-1699851309714-1699851321052 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-13 04:55:21,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1699851321053 (current time:1699851321053). 2023-11-13 04:55:21,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-11-13 04:55:21,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] zookeeper.ReadOnlyZKClient(139): Connect 0x0b85dc80 to 127.0.0.1:51072 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-13 04:55:21,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8f3cf21, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-13 04:55:21,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-13 04:55:21,062 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37086, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-13 04:55:21,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0b85dc80 to 127.0.0.1:51072 2023-11-13 04:55:21,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-13 04:55:21,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-11-13 04:55:21,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] snapshot.SnapshotManager(695): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1699851309714-1699851321052 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-13 04:55:21,065 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.hbase-snapshot, current working dir path: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1699851309714-1699851321052 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotDisabledTable(SnapshotManager.java:541) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:698) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-11-13 04:55:21,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-13 04:55:21,068 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-13 04:55:21,068 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1699851921068 2023-11-13 04:55:21,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] snapshot.SnapshotManager(700): Started snapshot: { ss=hbase-failsafe-snaptb-1699851309714-1699851321052 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-13 04:55:21,068 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1699851309714-1699851321052 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-11-13 04:55:21,069 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1699851309714-1699851321052 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-11-13 04:55:21,069 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-11-13 04:55:21,169 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-13 04:55:21,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1699851309714-1699851321052 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-13 04:55:21,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1699851309714-1699851321052 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-13 04:55:21,170 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-11-13 04:55:21,370 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-13 04:55:21,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1699851309714-1699851321052 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-13 04:55:21,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1699851309714-1699851321052 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-13 04:55:21,371 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-11-13 04:55:21,475 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1699851309714-1699851321052 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-11-13 04:55:21,477 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-13 04:55:21,477 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-13 04:55:21,477 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-13 04:55:21,477 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-13 04:55:21,477 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-13 04:55:21,477 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-13 04:55:21,477 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-13 04:55:21,477 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-13 04:55:21,480 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/4e0dbdd1cb8746f8ace4ce666be37ecd, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/95a804284b0243899f40bf451f9f1603_SeqId_29_] hfiles 2023-11-13 04:55:21,480 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/4e0dbdd1cb8746f8ace4ce666be37ecd 2023-11-13 04:55:21,480 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/95a804284b0243899f40bf451f9f1603_SeqId_29_ 2023-11-13 04:55:21,480 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/6453bbc9b42e419d8a1844a5f14796d7, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/c2900e5cf99f4354acf8024b75dee44e_SeqId_29_] hfiles 2023-11-13 04:55:21,480 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/6453bbc9b42e419d8a1844a5f14796d7 2023-11-13 04:55:21,480 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/69352c43322746319229d6cb86dc39a4, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/9230653438bf4c04a425d3556cf437f2_SeqId_29_] hfiles 2023-11-13 04:55:21,480 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/c2900e5cf99f4354acf8024b75dee44e_SeqId_29_ 2023-11-13 04:55:21,480 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/69352c43322746319229d6cb86dc39a4 2023-11-13 04:55:21,480 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/9230653438bf4c04a425d3556cf437f2_SeqId_29_ 2023-11-13 04:55:21,480 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231113c12b904a29844a06a2ecc381ad5fb84f, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311130dcea92e7e474b75ae0efeb8b13e4bd7, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311134482cd522a6241eca7fc4ce5e0495677] hfiles 2023-11-13 04:55:21,481 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231113c12b904a29844a06a2ecc381ad5fb84f 2023-11-13 04:55:21,481 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311130dcea92e7e474b75ae0efeb8b13e4bd7 2023-11-13 04:55:21,481 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311134482cd522a6241eca7fc4ce5e0495677 2023-11-13 04:55:21,481 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/dac2b42da66b4ca985cee8d97740757f] hfiles 2023-11-13 04:55:21,481 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/dac2b42da66b4ca985cee8d97740757f 2023-11-13 04:55:21,481 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/c8367a051edc468f8a0c18a9bdf76e08] hfiles 2023-11-13 04:55:21,481 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/64bb6b42c66c47b1a0fa7dd14a636354] hfiles 2023-11-13 04:55:21,481 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/c8367a051edc468f8a0c18a9bdf76e08 2023-11-13 04:55:21,482 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/64bb6b42c66c47b1a0fa7dd14a636354 2023-11-13 04:55:21,488 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231113071d0287206243239789636b4dc85b96, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311131d816f9718ba450b8d3af53327a04889_del, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231113850b5dc25ed348ca982bca07c46fc7ec, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231113de726c0b2aca43acb6c2a70fa4a3634a, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231113e8e4613a8a8f4269bee5ece2df9b6412, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311134506f21f51864a8a81a5e9e3cd72c05e_del, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023111351e97193a3d546a7a8b08e3a25a5f470, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231113939643500d7b477fad4541b401fc96a8, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231113b6d9022a12af4fe8a9073d8529f1c53f, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231113cd6623de188141a491050ec84c9df57b, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311132158d5340c38487e8ae0c5ed11be2314, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311132d54a04b895f4a33a0655831e481ee23, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111346efaa5f2574453c9dbabc830b5d3db4, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111390eeffa2d10541da821f54f8dd3aa9e0, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231113ffb3b7a04e354ec2b4c8e35111de3f82_del] hfiles 2023-11-13 04:55:21,488 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231113071d0287206243239789636b4dc85b96 2023-11-13 04:55:21,488 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311131d816f9718ba450b8d3af53327a04889_del 2023-11-13 04:55:21,488 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231113850b5dc25ed348ca982bca07c46fc7ec 2023-11-13 04:55:21,488 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231113de726c0b2aca43acb6c2a70fa4a3634a 2023-11-13 04:55:21,488 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231113e8e4613a8a8f4269bee5ece2df9b6412 2023-11-13 04:55:21,488 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311134506f21f51864a8a81a5e9e3cd72c05e_del 2023-11-13 04:55:21,488 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023111351e97193a3d546a7a8b08e3a25a5f470 2023-11-13 04:55:21,488 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231113939643500d7b477fad4541b401fc96a8 2023-11-13 04:55:21,488 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231113b6d9022a12af4fe8a9073d8529f1c53f 2023-11-13 04:55:21,488 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231113cd6623de188141a491050ec84c9df57b 2023-11-13 04:55:21,488 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311132158d5340c38487e8ae0c5ed11be2314 2023-11-13 04:55:21,488 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311132d54a04b895f4a33a0655831e481ee23 2023-11-13 04:55:21,488 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111346efaa5f2574453c9dbabc830b5d3db4 2023-11-13 04:55:21,488 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111390eeffa2d10541da821f54f8dd3aa9e0 2023-11-13 04:55:21,488 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231113ffb3b7a04e354ec2b4c8e35111de3f82_del 2023-11-13 04:55:21,671 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-13 04:55:21,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1699851309714-1699851321052 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-13 04:55:21,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1699851309714-1699851321052 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-13 04:55:21,672 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-11-13 04:55:21,888 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1699851309714-1699851321052 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-11-13 04:55:21,888 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1699851309714-1699851321052 2023-11-13 04:55:21,889 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1699851309714-1699851321052 2023-11-13 04:55:22,173 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-13 04:55:22,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1699851309714-1699851321052 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-13 04:55:22,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1699851309714-1699851321052 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-13 04:55:22,174 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-11-13 04:55:22,317 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1699851309714-1699851321052 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.hbase-snapshot/hbase-failsafe-snaptb-1699851309714-1699851321052 2023-11-13 04:55:22,317 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1699851309714-1699851321052 of table testCompactionWithHFileLink completed 2023-11-13 04:55:22,317 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1699851309714-1699851321052 2023-11-13 04:55:22,318 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1699851309714-1699851321052 2023-11-13 04:55:22,318 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1699851309714-1699851321052 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1699851321069Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1699851309714-1699851321052 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1699851321475 (+406 ms)Consolidate snapshot: hbase-failsafe-snaptb-1699851309714-1699851321052 at 1699851321888 (+413 ms)Loading Region manifests for hbase-failsafe-snaptb-1699851309714-1699851321052 at 1699851321888Writing data manifest for hbase-failsafe-snaptb-1699851309714-1699851321052 at 1699851321891 (+3 ms)Verifying snapshot: hbase-failsafe-snaptb-1699851309714-1699851321052 at 1699851322297 (+406 ms)Snapshot hbase-failsafe-snaptb-1699851309714-1699851321052 of table testCompactionWithHFileLink completed at 1699851322317 (+20 ms) 2023-11-13 04:55:22,319 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-13 04:55:22,320 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 1.2530 sec 2023-11-13 04:55:23,174 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-13 04:55:23,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1699851309714-1699851321052 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-13 04:55:23,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] snapshot.SnapshotManager(403): Snapshot '{ ss=hbase-failsafe-snaptb-1699851309714-1699851321052 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-11-13 04:55:23,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1699851309714" table: "testCompactionWithHFileLink" creation_time: 1699851309723 type: FLUSH version: 2 ttl: 0 ) 2023-11-13 04:55:23,216 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] snapshot.SnapshotManager(916): Restore snapshot=snaptb-1699851309714 as table=testCompactionWithHFileLink 2023-11-13 04:55:23,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-13 04:55:23,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-13 04:55:23,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-13 04:55:23,627 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-11-13 04:55:23,628 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-11-13 04:55:23,628 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-11-13 04:55:23,629 INFO [PEWorker-5] procedure.RestoreSnapshotProcedure(384): Starting restore snapshot={ ss=snaptb-1699851309714 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-13 04:55:23,633 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1699851309714" table: "testCompactionWithHFileLink" creation_time: 1699851309723 type: FLUSH version: 2 ttl: 0 2023-11-13 04:55:23,633 DEBUG [PEWorker-5] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink 2023-11-13 04:55:23,638 DEBUG [PEWorker-5] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-11-13 04:55:23,641 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311130dcea92e7e474b75ae0efeb8b13e4bd7 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311130dcea92e7e474b75ae0efeb8b13e4bd7 2023-11-13 04:55:23,642 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231113c12b904a29844a06a2ecc381ad5fb84f to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231113c12b904a29844a06a2ecc381ad5fb84f 2023-11-13 04:55:23,643 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311134482cd522a6241eca7fc4ce5e0495677 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311134482cd522a6241eca7fc4ce5e0495677 2023-11-13 04:55:23,644 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b2023111343a962cdb9454855b1cba6892085e038 of snapshot=snaptb-1699851309714 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-13 04:55:23,647 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231113a01b6cba5f564864bf45c965c8cd4871 of snapshot=snaptb-1699851309714 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-13 04:55:23,650 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231113c7bb0d4adb7e47fa816b3246d1d1523e of snapshot=snaptb-1699851309714 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-13 04:55:23,653 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231113f2f4bd37329a480bbfee9819afebc9a3 of snapshot=snaptb-1699851309714 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-13 04:55:23,656 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202311137b3eadda4c934e8f9d523657a0b77183 of snapshot=snaptb-1699851309714 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-13 04:55:23,658 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231113a253e2457d5f435ebee6f1ee36f55d25 of snapshot=snaptb-1699851309714 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-13 04:55:23,661 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231113dd59155911b448159fdd1cef1c0b1083 of snapshot=snaptb-1699851309714 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-13 04:55:23,664 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231113f6671f6d9d62429f971e5c2dd1292622 of snapshot=snaptb-1699851309714 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-13 04:55:23,667 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e2023111365f56168a30e4de6aa4908b7a0069dc8 of snapshot=snaptb-1699851309714 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-13 04:55:23,670 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e2023111378016b094e234a4386415dae4a14c642 of snapshot=snaptb-1699851309714 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-13 04:55:23,673 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e2023111382d6195e776e49da80fb040337f6e2f1 of snapshot=snaptb-1699851309714 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-13 04:55:23,676 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202311138a7e2bf3f47841619b334d10c3ce3fd4 of snapshot=snaptb-1699851309714 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-13 04:55:23,681 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311134506f21f51864a8a81a5e9e3cd72c05e_del to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311134506f21f51864a8a81a5e9e3cd72c05e_del 2023-11-13 04:55:23,682 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311131d816f9718ba450b8d3af53327a04889_del to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311131d816f9718ba450b8d3af53327a04889_del 2023-11-13 04:55:23,684 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231113ffb3b7a04e354ec2b4c8e35111de3f82_del to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231113ffb3b7a04e354ec2b4c8e35111de3f82_del 2023-11-13 04:55:23,684 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(223): region to restore: 6638aa08a24bc6e34e9840c49e638c8a 2023-11-13 04:55:23,684 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(223): region to restore: bfeed2e88ce202cf921374d6d67968c7 2023-11-13 04:55:23,684 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(223): region to restore: e13efa47a2338bfc8c25006e697a36d8 2023-11-13 04:55:23,688 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/4e0dbdd1cb8746f8ace4ce666be37ecd to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/4e0dbdd1cb8746f8ace4ce666be37ecd 2023-11-13 04:55:23,688 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/69352c43322746319229d6cb86dc39a4 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/69352c43322746319229d6cb86dc39a4 2023-11-13 04:55:23,688 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/6453bbc9b42e419d8a1844a5f14796d7 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/6453bbc9b42e419d8a1844a5f14796d7 2023-11-13 04:55:23,689 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/95a804284b0243899f40bf451f9f1603_SeqId_29_ to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/95a804284b0243899f40bf451f9f1603_SeqId_29_ 2023-11-13 04:55:23,689 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/9230653438bf4c04a425d3556cf437f2_SeqId_29_ to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/9230653438bf4c04a425d3556cf437f2_SeqId_29_ 2023-11-13 04:55:23,690 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 390824bbfce04fd9ac1b935a17760523 of snapshot=snaptb-1699851309714 to region=e13efa47a2338bfc8c25006e697a36d8 table=testCompactionWithHFileLink 2023-11-13 04:55:23,689 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink fccd59c304254894860a914ea6db14f2 of snapshot=snaptb-1699851309714 to region=bfeed2e88ce202cf921374d6d67968c7 table=testCompactionWithHFileLink 2023-11-13 04:55:23,690 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/c2900e5cf99f4354acf8024b75dee44e_SeqId_29_ to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/c2900e5cf99f4354acf8024b75dee44e_SeqId_29_ 2023-11-13 04:55:23,690 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 12c93e792bf84957ac292148d77afa10 of snapshot=snaptb-1699851309714 to region=6638aa08a24bc6e34e9840c49e638c8a table=testCompactionWithHFileLink 2023-11-13 04:55:23,694 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 2ea41d0a5fc141e4ad3d775a051b52a4 of snapshot=snaptb-1699851309714 to region=e13efa47a2338bfc8c25006e697a36d8 table=testCompactionWithHFileLink 2023-11-13 04:55:23,694 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c5987b1cd73845f98c8edc455ccf47dc of snapshot=snaptb-1699851309714 to region=bfeed2e88ce202cf921374d6d67968c7 table=testCompactionWithHFileLink 2023-11-13 04:55:23,695 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 4a4345fbfaf544a4bca8220aa5491d91 of snapshot=snaptb-1699851309714 to region=6638aa08a24bc6e34e9840c49e638c8a table=testCompactionWithHFileLink 2023-11-13 04:55:23,699 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 9db28e991279470d84afb14894901a51 of snapshot=snaptb-1699851309714 to region=6638aa08a24bc6e34e9840c49e638c8a table=testCompactionWithHFileLink 2023-11-13 04:55:23,699 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 2990516ad7cc46d3b9e125f204a3056a of snapshot=snaptb-1699851309714 to region=bfeed2e88ce202cf921374d6d67968c7 table=testCompactionWithHFileLink 2023-11-13 04:55:23,699 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 4e0fe736e59d4ea9950d123020a08137 of snapshot=snaptb-1699851309714 to region=e13efa47a2338bfc8c25006e697a36d8 table=testCompactionWithHFileLink 2023-11-13 04:55:23,703 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 08fde853956a475e89743233b5800da0 of snapshot=snaptb-1699851309714 to region=6638aa08a24bc6e34e9840c49e638c8a table=testCompactionWithHFileLink 2023-11-13 04:55:23,703 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 7fb2b16fcf754db5864380917a8c5ea9 of snapshot=snaptb-1699851309714 to region=bfeed2e88ce202cf921374d6d67968c7 table=testCompactionWithHFileLink 2023-11-13 04:55:23,703 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 0b548a931acb440487d096ffaf5c6b41 of snapshot=snaptb-1699851309714 to region=e13efa47a2338bfc8c25006e697a36d8 table=testCompactionWithHFileLink 2023-11-13 04:55:23,708 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/c8367a051edc468f8a0c18a9bdf76e08 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/c8367a051edc468f8a0c18a9bdf76e08 2023-11-13 04:55:23,708 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 86886665116d4ba293a13c09aedad26a of snapshot=snaptb-1699851309714 to region=6638aa08a24bc6e34e9840c49e638c8a table=testCompactionWithHFileLink 2023-11-13 04:55:23,709 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/dac2b42da66b4ca985cee8d97740757f to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/dac2b42da66b4ca985cee8d97740757f 2023-11-13 04:55:23,709 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 8f39ca4d1f2047799898b9eb81767fb1 of snapshot=snaptb-1699851309714 to region=bfeed2e88ce202cf921374d6d67968c7 table=testCompactionWithHFileLink 2023-11-13 04:55:23,710 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/64bb6b42c66c47b1a0fa7dd14a636354 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/64bb6b42c66c47b1a0fa7dd14a636354 2023-11-13 04:55:23,710 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 425709ac686d4a6599e4146cbc4e1457 of snapshot=snaptb-1699851309714 to region=e13efa47a2338bfc8c25006e697a36d8 table=testCompactionWithHFileLink 2023-11-13 04:55:23,721 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 3a385363c38c493db398a3eeb8c23c45 of snapshot=snaptb-1699851309714 to region=6638aa08a24bc6e34e9840c49e638c8a table=testCompactionWithHFileLink 2023-11-13 04:55:23,721 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 46c6c9a3dbd045e8a34a53ced1c80592 of snapshot=snaptb-1699851309714 to region=bfeed2e88ce202cf921374d6d67968c7 table=testCompactionWithHFileLink 2023-11-13 04:55:23,721 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 719456a418b4436fa26acb297228e658 of snapshot=snaptb-1699851309714 to region=e13efa47a2338bfc8c25006e697a36d8 table=testCompactionWithHFileLink 2023-11-13 04:55:23,728 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 9e729fa6d311473c96c179090d6b8367 of snapshot=snaptb-1699851309714 to region=6638aa08a24bc6e34e9840c49e638c8a table=testCompactionWithHFileLink 2023-11-13 04:55:23,728 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 52d64f3aa1c842828ad355d41c232a9a of snapshot=snaptb-1699851309714 to region=e13efa47a2338bfc8c25006e697a36d8 table=testCompactionWithHFileLink 2023-11-13 04:55:23,728 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ed2295265451475b90c1bdcd90481da6 of snapshot=snaptb-1699851309714 to region=bfeed2e88ce202cf921374d6d67968c7 table=testCompactionWithHFileLink 2023-11-13 04:55:23,731 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f6fb49bb4ab442b39a424a889d8ab93e of snapshot=snaptb-1699851309714 to region=6638aa08a24bc6e34e9840c49e638c8a table=testCompactionWithHFileLink 2023-11-13 04:55:23,732 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c6aa2bd8bb014b1a9a42a050ee5af1d6 of snapshot=snaptb-1699851309714 to region=bfeed2e88ce202cf921374d6d67968c7 table=testCompactionWithHFileLink 2023-11-13 04:55:23,732 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d7c4c89b37e547b6a119da3fe0471bf1 of snapshot=snaptb-1699851309714 to region=e13efa47a2338bfc8c25006e697a36d8 table=testCompactionWithHFileLink 2023-11-13 04:55:23,735 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1699851309714" table: "testCompactionWithHFileLink" creation_time: 1699851309723 type: FLUSH version: 2 ttl: 0 2023-11-13 04:55:23,737 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1699851323736"}]},"ts":"9223372036854775807"} 2023-11-13 04:55:23,737 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1699851323736"}]},"ts":"9223372036854775807"} 2023-11-13 04:55:23,737 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1699851323736"}]},"ts":"9223372036854775807"} 2023-11-13 04:55:23,738 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-11-13 04:55:23,738 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6638aa08a24bc6e34e9840c49e638c8a, NAME => 'testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => bfeed2e88ce202cf921374d6d67968c7, NAME => 'testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => e13efa47a2338bfc8c25006e697a36d8, NAME => 'testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8.', STARTKEY => '', ENDKEY => '1'}] 2023-11-13 04:55:23,739 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699851323737"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699851323737"}]},"ts":"1699851323737"} 2023-11-13 04:55:23,739 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699851323737"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699851323737"}]},"ts":"1699851323737"} 2023-11-13 04:55:23,739 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699851323737"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699851323737"}]},"ts":"1699851323737"} 2023-11-13 04:55:23,740 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-13 04:55:23,740 INFO [PEWorker-5] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-11-13 04:55:23,740 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 6638aa08a24bc6e34e9840c49e638c8a, NAME => 'testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => bfeed2e88ce202cf921374d6d67968c7, NAME => 'testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => e13efa47a2338bfc8c25006e697a36d8, NAME => 'testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8.', STARTKEY => '', ENDKEY => '1'}] 2023-11-13 04:55:23,741 INFO [PEWorker-5] procedure.RestoreSnapshotProcedure(457): Restore snapshot={ ss=snaptb-1699851309714 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-11-13 04:55:23,742 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1699851309714" table: "testCompactionWithHFileLink" creation_time: 1699851309723 type: FLUSH version: 2 ttl: 0 ) in 533 msec 2023-11-13 04:55:23,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-13 04:55:23,822 INFO [Listener at localhost/34517] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-11-13 04:55:23,823 INFO [Listener at localhost/34517] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1699851309714-1699851321052 2023-11-13 04:55:23,827 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "hbase-failsafe-snaptb-1699851309714-1699851321052" 2023-11-13 04:55:23,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] snapshot.SnapshotManager(335): Deleting snapshot: hbase-failsafe-snaptb-1699851309714-1699851321052 2023-11-13 04:55:23,831 INFO [Listener at localhost/34517] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-11-13 04:55:23,835 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.HMaster$10(2385): Client=jenkins//172.31.14.131 enable testCompactionWithHFileLink 2023-11-13 04:55:23,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-11-13 04:55:23,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-13 04:55:23,844 INFO [PEWorker-1] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-11-13 04:55:23,844 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699851323844"}]},"ts":"1699851323844"} 2023-11-13 04:55:23,845 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-11-13 04:55:23,848 DEBUG [PEWorker-1] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-11-13 04:55:23,848 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=e13efa47a2338bfc8c25006e697a36d8, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=6638aa08a24bc6e34e9840c49e638c8a, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=bfeed2e88ce202cf921374d6d67968c7, ASSIGN}] 2023-11-13 04:55:23,849 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=6638aa08a24bc6e34e9840c49e638c8a, ASSIGN 2023-11-13 04:55:23,849 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=e13efa47a2338bfc8c25006e697a36d8, ASSIGN 2023-11-13 04:55:23,849 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=bfeed2e88ce202cf921374d6d67968c7, ASSIGN 2023-11-13 04:55:23,850 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=6638aa08a24bc6e34e9840c49e638c8a, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-13 04:55:23,850 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=e13efa47a2338bfc8c25006e697a36d8, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-13 04:55:23,850 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=bfeed2e88ce202cf921374d6d67968c7, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-13 04:55:23,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-13 04:55:24,002 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=bfeed2e88ce202cf921374d6d67968c7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:24,002 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=6638aa08a24bc6e34e9840c49e638c8a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:24,002 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=e13efa47a2338bfc8c25006e697a36d8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:24,002 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699851324002"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699851324002"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699851324002"}]},"ts":"1699851324002"} 2023-11-13 04:55:24,002 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699851324002"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699851324002"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699851324002"}]},"ts":"1699851324002"} 2023-11-13 04:55:24,002 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699851324002"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699851324002"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699851324002"}]},"ts":"1699851324002"} 2023-11-13 04:55:24,003 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=101, ppid=100, state=RUNNABLE; OpenRegionProcedure bfeed2e88ce202cf921374d6d67968c7, server=jenkins-hbase4.apache.org,41657,1699851201532}] 2023-11-13 04:55:24,004 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=99, state=RUNNABLE; OpenRegionProcedure 6638aa08a24bc6e34e9840c49e638c8a, server=jenkins-hbase4.apache.org,41657,1699851201532}] 2023-11-13 04:55:24,004 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=98, state=RUNNABLE; OpenRegionProcedure e13efa47a2338bfc8c25006e697a36d8, server=jenkins-hbase4.apache.org,41657,1699851201532}] 2023-11-13 04:55:24,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-13 04:55:24,155 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:24,157 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7. 2023-11-13 04:55:24,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bfeed2e88ce202cf921374d6d67968c7, NAME => 'testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7.', STARTKEY => '2', ENDKEY => ''} 2023-11-13 04:55:24,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink bfeed2e88ce202cf921374d6d67968c7 2023-11-13 04:55:24,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-13 04:55:24,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bfeed2e88ce202cf921374d6d67968c7 2023-11-13 04:55:24,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bfeed2e88ce202cf921374d6d67968c7 2023-11-13 04:55:24,159 INFO [StoreOpener-bfeed2e88ce202cf921374d6d67968c7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region bfeed2e88ce202cf921374d6d67968c7 2023-11-13 04:55:24,159 DEBUG [StoreOpener-bfeed2e88ce202cf921374d6d67968c7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1 2023-11-13 04:55:24,160 DEBUG [StoreOpener-bfeed2e88ce202cf921374d6d67968c7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1 2023-11-13 04:55:24,160 INFO [StoreOpener-bfeed2e88ce202cf921374d6d67968c7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bfeed2e88ce202cf921374d6d67968c7 columnFamilyName family1 2023-11-13 04:55:24,169 DEBUG [StoreOpener-bfeed2e88ce202cf921374d6d67968c7-1] regionserver.HStore(539): loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/testCompactionWithHFileLink=bfeed2e88ce202cf921374d6d67968c7-2990516ad7cc46d3b9e125f204a3056a 2023-11-13 04:55:24,174 DEBUG [StoreOpener-bfeed2e88ce202cf921374d6d67968c7-1] regionserver.HStore(539): loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/testCompactionWithHFileLink=bfeed2e88ce202cf921374d6d67968c7-7fb2b16fcf754db5864380917a8c5ea9 2023-11-13 04:55:24,179 DEBUG [StoreOpener-bfeed2e88ce202cf921374d6d67968c7-1] regionserver.HStore(539): loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/testCompactionWithHFileLink=bfeed2e88ce202cf921374d6d67968c7-c5987b1cd73845f98c8edc455ccf47dc 2023-11-13 04:55:24,183 DEBUG [StoreOpener-bfeed2e88ce202cf921374d6d67968c7-1] regionserver.HStore(539): loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/testCompactionWithHFileLink=bfeed2e88ce202cf921374d6d67968c7-fccd59c304254894860a914ea6db14f2 2023-11-13 04:55:24,183 INFO [StoreOpener-bfeed2e88ce202cf921374d6d67968c7-1] regionserver.HStore(310): Store=bfeed2e88ce202cf921374d6d67968c7/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-13 04:55:24,184 INFO [StoreOpener-bfeed2e88ce202cf921374d6d67968c7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region bfeed2e88ce202cf921374d6d67968c7 2023-11-13 04:55:24,184 DEBUG [StoreOpener-bfeed2e88ce202cf921374d6d67968c7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2 2023-11-13 04:55:24,184 DEBUG [StoreOpener-bfeed2e88ce202cf921374d6d67968c7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2 2023-11-13 04:55:24,185 INFO [StoreOpener-bfeed2e88ce202cf921374d6d67968c7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bfeed2e88ce202cf921374d6d67968c7 columnFamilyName family2 2023-11-13 04:55:24,191 DEBUG [StoreOpener-bfeed2e88ce202cf921374d6d67968c7-1] regionserver.HStore(539): loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/testCompactionWithHFileLink=bfeed2e88ce202cf921374d6d67968c7-46c6c9a3dbd045e8a34a53ced1c80592 2023-11-13 04:55:24,196 DEBUG [StoreOpener-bfeed2e88ce202cf921374d6d67968c7-1] regionserver.HStore(539): loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/testCompactionWithHFileLink=bfeed2e88ce202cf921374d6d67968c7-8f39ca4d1f2047799898b9eb81767fb1 2023-11-13 04:55:24,201 DEBUG [StoreOpener-bfeed2e88ce202cf921374d6d67968c7-1] regionserver.HStore(539): loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/testCompactionWithHFileLink=bfeed2e88ce202cf921374d6d67968c7-c6aa2bd8bb014b1a9a42a050ee5af1d6 2023-11-13 04:55:24,205 DEBUG [StoreOpener-bfeed2e88ce202cf921374d6d67968c7-1] regionserver.HStore(539): loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/testCompactionWithHFileLink=bfeed2e88ce202cf921374d6d67968c7-ed2295265451475b90c1bdcd90481da6 2023-11-13 04:55:24,206 INFO [StoreOpener-bfeed2e88ce202cf921374d6d67968c7-1] regionserver.HStore(310): Store=bfeed2e88ce202cf921374d6d67968c7/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-13 04:55:24,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7 2023-11-13 04:55:24,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7 2023-11-13 04:55:24,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-13 04:55:24,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bfeed2e88ce202cf921374d6d67968c7 2023-11-13 04:55:24,210 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bfeed2e88ce202cf921374d6d67968c7; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63718651, jitterRate=-0.050518110394477844}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-13 04:55:24,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bfeed2e88ce202cf921374d6d67968c7: 2023-11-13 04:55:24,211 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7., pid=101, masterSystemTime=1699851324155 2023-11-13 04:55:24,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-13 04:55:24,211 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-13 04:55:24,211 DEBUG [RS:0;jenkins-hbase4:41657-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-13 04:55:24,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-13 04:55:24,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7. 2023-11-13 04:55:24,213 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7. 2023-11-13 04:55:24,213 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a. 2023-11-13 04:55:24,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6638aa08a24bc6e34e9840c49e638c8a, NAME => 'testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a.', STARTKEY => '1', ENDKEY => '2'} 2023-11-13 04:55:24,213 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=bfeed2e88ce202cf921374d6d67968c7, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:24,213 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699851324213"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699851324213"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699851324213"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699851324213"}]},"ts":"1699851324213"} 2023-11-13 04:55:24,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 6638aa08a24bc6e34e9840c49e638c8a 2023-11-13 04:55:24,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-13 04:55:24,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6638aa08a24bc6e34e9840c49e638c8a 2023-11-13 04:55:24,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6638aa08a24bc6e34e9840c49e638c8a 2023-11-13 04:55:24,214 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-13 04:55:24,214 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HStore(1912): bfeed2e88ce202cf921374d6d67968c7/family1 is initiating minor compaction (all files) 2023-11-13 04:55:24,214 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of bfeed2e88ce202cf921374d6d67968c7/family1 in testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7. 2023-11-13 04:55:24,214 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/testCompactionWithHFileLink=bfeed2e88ce202cf921374d6d67968c7-fccd59c304254894860a914ea6db14f2, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/testCompactionWithHFileLink=bfeed2e88ce202cf921374d6d67968c7-c5987b1cd73845f98c8edc455ccf47dc, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/testCompactionWithHFileLink=bfeed2e88ce202cf921374d6d67968c7-2990516ad7cc46d3b9e125f204a3056a, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/testCompactionWithHFileLink=bfeed2e88ce202cf921374d6d67968c7-7fb2b16fcf754db5864380917a8c5ea9] into tmpdir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/.tmp, totalSize=21.6 K 2023-11-13 04:55:24,214 DEBUG [RS:0;jenkins-hbase4:41657-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-13 04:55:24,214 DEBUG [RS:0;jenkins-hbase4:41657-longCompactions-0] regionserver.HStore(1912): bfeed2e88ce202cf921374d6d67968c7/family2 is initiating minor compaction (all files) 2023-11-13 04:55:24,214 INFO [RS:0;jenkins-hbase4:41657-longCompactions-0] regionserver.HRegion(2259): Starting compaction of bfeed2e88ce202cf921374d6d67968c7/family2 in testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7. 2023-11-13 04:55:24,215 INFO [RS:0;jenkins-hbase4:41657-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/testCompactionWithHFileLink=bfeed2e88ce202cf921374d6d67968c7-8f39ca4d1f2047799898b9eb81767fb1, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/testCompactionWithHFileLink=bfeed2e88ce202cf921374d6d67968c7-46c6c9a3dbd045e8a34a53ced1c80592, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/testCompactionWithHFileLink=bfeed2e88ce202cf921374d6d67968c7-ed2295265451475b90c1bdcd90481da6, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/testCompactionWithHFileLink=bfeed2e88ce202cf921374d6d67968c7-c6aa2bd8bb014b1a9a42a050ee5af1d6] into tmpdir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/.tmp, totalSize=20.4 K 2023-11-13 04:55:24,215 INFO [StoreOpener-6638aa08a24bc6e34e9840c49e638c8a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 6638aa08a24bc6e34e9840c49e638c8a 2023-11-13 04:55:24,216 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=bfeed2e88ce202cf921374d6d67968c7-fccd59c304254894860a914ea6db14f2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699851302516 2023-11-13 04:55:24,216 DEBUG [RS:0;jenkins-hbase4:41657-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=bfeed2e88ce202cf921374d6d67968c7-8f39ca4d1f2047799898b9eb81767fb1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699851302516 2023-11-13 04:55:24,216 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=100 2023-11-13 04:55:24,216 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=100, state=SUCCESS; OpenRegionProcedure bfeed2e88ce202cf921374d6d67968c7, server=jenkins-hbase4.apache.org,41657,1699851201532 in 212 msec 2023-11-13 04:55:24,217 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=bfeed2e88ce202cf921374d6d67968c7-c5987b1cd73845f98c8edc455ccf47dc, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699851304295 2023-11-13 04:55:24,217 DEBUG [RS:0;jenkins-hbase4:41657-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=bfeed2e88ce202cf921374d6d67968c7-46c6c9a3dbd045e8a34a53ced1c80592, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699851304295 2023-11-13 04:55:24,217 DEBUG [StoreOpener-6638aa08a24bc6e34e9840c49e638c8a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1 2023-11-13 04:55:24,217 DEBUG [StoreOpener-6638aa08a24bc6e34e9840c49e638c8a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1 2023-11-13 04:55:24,217 INFO [StoreOpener-6638aa08a24bc6e34e9840c49e638c8a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6638aa08a24bc6e34e9840c49e638c8a columnFamilyName family1 2023-11-13 04:55:24,218 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=bfeed2e88ce202cf921374d6d67968c7-2990516ad7cc46d3b9e125f204a3056a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699851306114 2023-11-13 04:55:24,218 DEBUG [RS:0;jenkins-hbase4:41657-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=bfeed2e88ce202cf921374d6d67968c7-ed2295265451475b90c1bdcd90481da6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699851306114 2023-11-13 04:55:24,218 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=bfeed2e88ce202cf921374d6d67968c7, ASSIGN in 369 msec 2023-11-13 04:55:24,218 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=bfeed2e88ce202cf921374d6d67968c7-7fb2b16fcf754db5864380917a8c5ea9, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699851307908 2023-11-13 04:55:24,218 DEBUG [RS:0;jenkins-hbase4:41657-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=bfeed2e88ce202cf921374d6d67968c7-c6aa2bd8bb014b1a9a42a050ee5af1d6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699851307908 2023-11-13 04:55:24,234 DEBUG [StoreOpener-6638aa08a24bc6e34e9840c49e638c8a-1] regionserver.HStore(539): loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/testCompactionWithHFileLink=6638aa08a24bc6e34e9840c49e638c8a-08fde853956a475e89743233b5800da0 2023-11-13 04:55:24,242 DEBUG [StoreOpener-6638aa08a24bc6e34e9840c49e638c8a-1] regionserver.HStore(539): loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/testCompactionWithHFileLink=6638aa08a24bc6e34e9840c49e638c8a-12c93e792bf84957ac292148d77afa10 2023-11-13 04:55:24,259 DEBUG [StoreOpener-6638aa08a24bc6e34e9840c49e638c8a-1] regionserver.HStore(539): loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/testCompactionWithHFileLink=6638aa08a24bc6e34e9840c49e638c8a-4a4345fbfaf544a4bca8220aa5491d91 2023-11-13 04:55:24,265 INFO [RS:0;jenkins-hbase4:41657-longCompactions-0] throttle.PressureAwareThroughputController(145): bfeed2e88ce202cf921374d6d67968c7#family2#compaction#113 average throughput is 0.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 50.00 MB/second 2023-11-13 04:55:24,270 DEBUG [StoreOpener-6638aa08a24bc6e34e9840c49e638c8a-1] regionserver.HStore(539): loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/testCompactionWithHFileLink=6638aa08a24bc6e34e9840c49e638c8a-9db28e991279470d84afb14894901a51 2023-11-13 04:55:24,273 INFO [StoreOpener-6638aa08a24bc6e34e9840c49e638c8a-1] regionserver.HStore(310): Store=6638aa08a24bc6e34e9840c49e638c8a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-13 04:55:24,273 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] throttle.PressureAwareThroughputController(145): bfeed2e88ce202cf921374d6d67968c7#family1#compaction#114 average throughput is 0.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-13 04:55:24,273 INFO [StoreOpener-6638aa08a24bc6e34e9840c49e638c8a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 6638aa08a24bc6e34e9840c49e638c8a 2023-11-13 04:55:24,274 DEBUG [StoreOpener-6638aa08a24bc6e34e9840c49e638c8a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2 2023-11-13 04:55:24,274 DEBUG [StoreOpener-6638aa08a24bc6e34e9840c49e638c8a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2 2023-11-13 04:55:24,275 INFO [StoreOpener-6638aa08a24bc6e34e9840c49e638c8a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6638aa08a24bc6e34e9840c49e638c8a columnFamilyName family2 2023-11-13 04:55:24,291 DEBUG [StoreOpener-6638aa08a24bc6e34e9840c49e638c8a-1] regionserver.HStore(539): loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/testCompactionWithHFileLink=6638aa08a24bc6e34e9840c49e638c8a-3a385363c38c493db398a3eeb8c23c45 2023-11-13 04:55:24,296 DEBUG [StoreOpener-6638aa08a24bc6e34e9840c49e638c8a-1] regionserver.HStore(539): loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/testCompactionWithHFileLink=6638aa08a24bc6e34e9840c49e638c8a-86886665116d4ba293a13c09aedad26a 2023-11-13 04:55:24,300 DEBUG [StoreOpener-6638aa08a24bc6e34e9840c49e638c8a-1] regionserver.HStore(539): loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/testCompactionWithHFileLink=6638aa08a24bc6e34e9840c49e638c8a-9e729fa6d311473c96c179090d6b8367 2023-11-13 04:55:24,307 DEBUG [StoreOpener-6638aa08a24bc6e34e9840c49e638c8a-1] regionserver.HStore(539): loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/testCompactionWithHFileLink=6638aa08a24bc6e34e9840c49e638c8a-f6fb49bb4ab442b39a424a889d8ab93e 2023-11-13 04:55:24,307 INFO [StoreOpener-6638aa08a24bc6e34e9840c49e638c8a-1] regionserver.HStore(310): Store=6638aa08a24bc6e34e9840c49e638c8a/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-13 04:55:24,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a 2023-11-13 04:55:24,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a 2023-11-13 04:55:24,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-13 04:55:24,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6638aa08a24bc6e34e9840c49e638c8a 2023-11-13 04:55:24,312 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6638aa08a24bc6e34e9840c49e638c8a; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65145405, jitterRate=-0.029257819056510925}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-13 04:55:24,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6638aa08a24bc6e34e9840c49e638c8a: 2023-11-13 04:55:24,312 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a., pid=102, masterSystemTime=1699851324155 2023-11-13 04:55:24,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-11-13 04:55:24,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-11-13 04:55:24,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a. 2023-11-13 04:55:24,314 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a. 2023-11-13 04:55:24,314 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8. 2023-11-13 04:55:24,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e13efa47a2338bfc8c25006e697a36d8, NAME => 'testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8.', STARTKEY => '', ENDKEY => '1'} 2023-11-13 04:55:24,314 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=6638aa08a24bc6e34e9840c49e638c8a, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:24,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink e13efa47a2338bfc8c25006e697a36d8 2023-11-13 04:55:24,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-13 04:55:24,314 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699851324314"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699851324314"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699851324314"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699851324314"}]},"ts":"1699851324314"} 2023-11-13 04:55:24,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e13efa47a2338bfc8c25006e697a36d8 2023-11-13 04:55:24,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e13efa47a2338bfc8c25006e697a36d8 2023-11-13 04:55:24,315 INFO [StoreOpener-e13efa47a2338bfc8c25006e697a36d8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e13efa47a2338bfc8c25006e697a36d8 2023-11-13 04:55:24,316 DEBUG [StoreOpener-e13efa47a2338bfc8c25006e697a36d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1 2023-11-13 04:55:24,316 DEBUG [StoreOpener-e13efa47a2338bfc8c25006e697a36d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1 2023-11-13 04:55:24,317 INFO [StoreOpener-e13efa47a2338bfc8c25006e697a36d8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e13efa47a2338bfc8c25006e697a36d8 columnFamilyName family1 2023-11-13 04:55:24,319 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=99 2023-11-13 04:55:24,319 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=99, state=SUCCESS; OpenRegionProcedure 6638aa08a24bc6e34e9840c49e638c8a, server=jenkins-hbase4.apache.org,41657,1699851201532 in 313 msec 2023-11-13 04:55:24,319 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=6638aa08a24bc6e34e9840c49e638c8a, ASSIGN in 471 msec 2023-11-13 04:55:24,323 DEBUG [StoreOpener-e13efa47a2338bfc8c25006e697a36d8-1] regionserver.HStore(539): loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/testCompactionWithHFileLink=e13efa47a2338bfc8c25006e697a36d8-0b548a931acb440487d096ffaf5c6b41 2023-11-13 04:55:24,329 DEBUG [StoreOpener-e13efa47a2338bfc8c25006e697a36d8-1] regionserver.HStore(539): loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/testCompactionWithHFileLink=e13efa47a2338bfc8c25006e697a36d8-2ea41d0a5fc141e4ad3d775a051b52a4 2023-11-13 04:55:24,335 DEBUG [StoreOpener-e13efa47a2338bfc8c25006e697a36d8-1] regionserver.HStore(539): loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/testCompactionWithHFileLink=e13efa47a2338bfc8c25006e697a36d8-390824bbfce04fd9ac1b935a17760523 2023-11-13 04:55:24,340 DEBUG [StoreOpener-e13efa47a2338bfc8c25006e697a36d8-1] regionserver.HStore(539): loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/testCompactionWithHFileLink=e13efa47a2338bfc8c25006e697a36d8-4e0fe736e59d4ea9950d123020a08137 2023-11-13 04:55:24,340 INFO [StoreOpener-e13efa47a2338bfc8c25006e697a36d8-1] regionserver.HStore(310): Store=e13efa47a2338bfc8c25006e697a36d8/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-13 04:55:24,341 INFO [StoreOpener-e13efa47a2338bfc8c25006e697a36d8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region e13efa47a2338bfc8c25006e697a36d8 2023-11-13 04:55:24,341 DEBUG [StoreOpener-e13efa47a2338bfc8c25006e697a36d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2 2023-11-13 04:55:24,341 DEBUG [StoreOpener-e13efa47a2338bfc8c25006e697a36d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2 2023-11-13 04:55:24,342 INFO [StoreOpener-e13efa47a2338bfc8c25006e697a36d8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e13efa47a2338bfc8c25006e697a36d8 columnFamilyName family2 2023-11-13 04:55:24,349 DEBUG [StoreOpener-e13efa47a2338bfc8c25006e697a36d8-1] regionserver.HStore(539): loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/testCompactionWithHFileLink=e13efa47a2338bfc8c25006e697a36d8-425709ac686d4a6599e4146cbc4e1457 2023-11-13 04:55:24,354 DEBUG [StoreOpener-e13efa47a2338bfc8c25006e697a36d8-1] regionserver.HStore(539): loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/testCompactionWithHFileLink=e13efa47a2338bfc8c25006e697a36d8-52d64f3aa1c842828ad355d41c232a9a 2023-11-13 04:55:24,359 DEBUG [StoreOpener-e13efa47a2338bfc8c25006e697a36d8-1] regionserver.HStore(539): loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/testCompactionWithHFileLink=e13efa47a2338bfc8c25006e697a36d8-719456a418b4436fa26acb297228e658 2023-11-13 04:55:24,365 DEBUG [StoreOpener-e13efa47a2338bfc8c25006e697a36d8-1] regionserver.HStore(539): loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/testCompactionWithHFileLink=e13efa47a2338bfc8c25006e697a36d8-d7c4c89b37e547b6a119da3fe0471bf1 2023-11-13 04:55:24,365 INFO [StoreOpener-e13efa47a2338bfc8c25006e697a36d8-1] regionserver.HStore(310): Store=e13efa47a2338bfc8c25006e697a36d8/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-13 04:55:24,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8 2023-11-13 04:55:24,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8 2023-11-13 04:55:24,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-13 04:55:24,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e13efa47a2338bfc8c25006e697a36d8 2023-11-13 04:55:24,370 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e13efa47a2338bfc8c25006e697a36d8; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66644298, jitterRate=-0.00692257285118103}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-13 04:55:24,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e13efa47a2338bfc8c25006e697a36d8: 2023-11-13 04:55:24,371 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8., pid=103, masterSystemTime=1699851324155 2023-11-13 04:55:24,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-11-13 04:55:24,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-11-13 04:55:24,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8. 2023-11-13 04:55:24,372 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8. 2023-11-13 04:55:24,372 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=e13efa47a2338bfc8c25006e697a36d8, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:24,373 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699851324372"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699851324372"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699851324372"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699851324372"}]},"ts":"1699851324372"} 2023-11-13 04:55:24,375 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=98 2023-11-13 04:55:24,375 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=98, state=SUCCESS; OpenRegionProcedure e13efa47a2338bfc8c25006e697a36d8, server=jenkins-hbase4.apache.org,41657,1699851201532 in 370 msec 2023-11-13 04:55:24,376 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=98, resume processing ppid=97 2023-11-13 04:55:24,376 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=e13efa47a2338bfc8c25006e697a36d8, ASSIGN in 527 msec 2023-11-13 04:55:24,376 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699851324376"}]},"ts":"1699851324376"} 2023-11-13 04:55:24,377 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-11-13 04:55:24,380 INFO [PEWorker-1] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-11-13 04:55:24,382 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 545 msec 2023-11-13 04:55:24,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-13 04:55:24,446 INFO [Listener at localhost/34517] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-11-13 04:55:24,457 DEBUG [Listener at localhost/34517] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-13 04:55:24,463 DEBUG [Listener at localhost/34517] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-13 04:55:24,473 DEBUG [Listener at localhost/34517] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-13 04:55:24,474 DEBUG [Listener at localhost/34517] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-13 04:55:24,481 INFO [Listener at localhost/34517] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-13 04:55:24,497 INFO [Listener at localhost/34517] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-11-13 04:55:24,497 INFO [Listener at localhost/34517] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-11-13 04:55:24,498 DEBUG [Listener at localhost/34517] zookeeper.ReadOnlyZKClient(139): Connect 0x3d642271 to 127.0.0.1:51072 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-13 04:55:24,502 DEBUG [Listener at localhost/34517] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18d600d5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-13 04:55:24,503 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231113 for table='testCompactionWithHFileLink' and column='family1' 2023-11-13 04:55:24,503 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231113 for table='testCompactionWithHFileLink' and column='family1' 2023-11-13 04:55:24,503 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231113 for table='testCompactionWithHFileLink' and column='family1' 2023-11-13 04:55:25,099 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/.tmp/family1/9dcaa4a8dfae41009435e56abb4925ef as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/9dcaa4a8dfae41009435e56abb4925ef 2023-11-13 04:55:25,103 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-11-13 04:55:25,104 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in bfeed2e88ce202cf921374d6d67968c7/family1 of bfeed2e88ce202cf921374d6d67968c7 into 9dcaa4a8dfae41009435e56abb4925ef(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-13 04:55:25,104 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for bfeed2e88ce202cf921374d6d67968c7: 2023-11-13 04:55:25,104 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7., storeName=bfeed2e88ce202cf921374d6d67968c7/family1, priority=12, startTime=1699851324211; duration=0sec 2023-11-13 04:55:25,105 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-11-13 04:55:25,105 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-13 04:55:25,107 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-13 04:55:25,108 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HStore(1912): 6638aa08a24bc6e34e9840c49e638c8a/family1 is initiating minor compaction (all files) 2023-11-13 04:55:25,108 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 6638aa08a24bc6e34e9840c49e638c8a/family1 in testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a. 2023-11-13 04:55:25,108 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/testCompactionWithHFileLink=6638aa08a24bc6e34e9840c49e638c8a-12c93e792bf84957ac292148d77afa10, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/testCompactionWithHFileLink=6638aa08a24bc6e34e9840c49e638c8a-4a4345fbfaf544a4bca8220aa5491d91, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/testCompactionWithHFileLink=6638aa08a24bc6e34e9840c49e638c8a-9db28e991279470d84afb14894901a51, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/testCompactionWithHFileLink=6638aa08a24bc6e34e9840c49e638c8a-08fde853956a475e89743233b5800da0] into tmpdir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/.tmp, totalSize=21.6 K 2023-11-13 04:55:25,108 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=6638aa08a24bc6e34e9840c49e638c8a-12c93e792bf84957ac292148d77afa10, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699851302515 2023-11-13 04:55:25,109 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=6638aa08a24bc6e34e9840c49e638c8a-4a4345fbfaf544a4bca8220aa5491d91, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699851304294 2023-11-13 04:55:25,110 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=6638aa08a24bc6e34e9840c49e638c8a-9db28e991279470d84afb14894901a51, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699851306113 2023-11-13 04:55:25,110 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=6638aa08a24bc6e34e9840c49e638c8a-08fde853956a475e89743233b5800da0, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699851307908 2023-11-13 04:55:25,121 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/testCompactionWithHFileLink=bfeed2e88ce202cf921374d6d67968c7-fccd59c304254894860a914ea6db14f2, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/testCompactionWithHFileLink=bfeed2e88ce202cf921374d6d67968c7-c5987b1cd73845f98c8edc455ccf47dc, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/testCompactionWithHFileLink=bfeed2e88ce202cf921374d6d67968c7-2990516ad7cc46d3b9e125f204a3056a, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/testCompactionWithHFileLink=bfeed2e88ce202cf921374d6d67968c7-7fb2b16fcf754db5864380917a8c5ea9] to archive 2023-11-13 04:55:25,121 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:55:25,123 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/testCompactionWithHFileLink=bfeed2e88ce202cf921374d6d67968c7-fccd59c304254894860a914ea6db14f2 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/testCompactionWithHFileLink=bfeed2e88ce202cf921374d6d67968c7-fccd59c304254894860a914ea6db14f2 2023-11-13 04:55:25,124 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/testCompactionWithHFileLink=bfeed2e88ce202cf921374d6d67968c7-c5987b1cd73845f98c8edc455ccf47dc to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/testCompactionWithHFileLink=bfeed2e88ce202cf921374d6d67968c7-c5987b1cd73845f98c8edc455ccf47dc 2023-11-13 04:55:25,125 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/testCompactionWithHFileLink=bfeed2e88ce202cf921374d6d67968c7-2990516ad7cc46d3b9e125f204a3056a to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/testCompactionWithHFileLink=bfeed2e88ce202cf921374d6d67968c7-2990516ad7cc46d3b9e125f204a3056a 2023-11-13 04:55:25,126 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/testCompactionWithHFileLink=bfeed2e88ce202cf921374d6d67968c7-7fb2b16fcf754db5864380917a8c5ea9 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/testCompactionWithHFileLink=bfeed2e88ce202cf921374d6d67968c7-7fb2b16fcf754db5864380917a8c5ea9 2023-11-13 04:55:25,126 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] throttle.PressureAwareThroughputController(145): 6638aa08a24bc6e34e9840c49e638c8a#family1#compaction#115 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-13 04:55:25,391 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111332975707f16b4c5887a4236a17f78df2 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023111332975707f16b4c5887a4236a17f78df2 2023-11-13 04:55:25,392 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231113 table='testCompactionWithHFileLink' column='family1' 2023-11-13 04:55:25,392 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311132932ca8a70f1464180ac7d2614731308 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311132932ca8a70f1464180ac7d2614731308 2023-11-13 04:55:25,394 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231113008b061c6748450795bded7c68b564bc to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231113008b061c6748450795bded7c68b564bc 2023-11-13 04:55:25,399 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231113 table='testCompactionWithHFileLink' column='family1' 2023-11-13 04:55:25,399 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231113 table='testCompactionWithHFileLink' column='family1' 2023-11-13 04:55:25,407 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-13 04:55:25,411 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48662, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-13 04:55:25,420 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-13 04:55:25,429 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52386, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-13 04:55:25,446 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231113/family1/0c2954d3ad8441f9a05026122e26db50 first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-11-13 04:55:25,446 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231113/family1/501dd85b4ba04d71a5b0ab2d4bcfd10d first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-11-13 04:55:25,447 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8., hostname=jenkins-hbase4.apache.org,41657,1699851201532, seqNum=32 for row with hfile group [{family1,hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231113/family1/0c2954d3ad8441f9a05026122e26db50}] 2023-11-13 04:55:25,447 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7., hostname=jenkins-hbase4.apache.org,41657,1699851201532, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231113/family1/501dd85b4ba04d71a5b0ab2d4bcfd10d}] 2023-11-13 04:55:25,450 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231113/family1/b63992f054834bf28afc7aeb58facbac first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-11-13 04:55:25,451 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a., hostname=jenkins-hbase4.apache.org,41657,1699851201532, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231113/family1/b63992f054834bf28afc7aeb58facbac}] 2023-11-13 04:55:25,452 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(763): Validating hfile at hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231113/family1/0c2954d3ad8441f9a05026122e26db50 for inclusion in e13efa47a2338bfc8c25006e697a36d8/family1 2023-11-13 04:55:25,452 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(763): Validating hfile at hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231113/family1/501dd85b4ba04d71a5b0ab2d4bcfd10d for inclusion in bfeed2e88ce202cf921374d6d67968c7/family1 2023-11-13 04:55:25,453 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41657] regionserver.HStore(763): Validating hfile at hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231113/family1/b63992f054834bf28afc7aeb58facbac for inclusion in 6638aa08a24bc6e34e9840c49e638c8a/family1 2023-11-13 04:55:25,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-11-13 04:55:25,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-13 04:55:25,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HRegion(2446): Flush status journal for bfeed2e88ce202cf921374d6d67968c7: 2023-11-13 04:55:25,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-11-13 04:55:25,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(777): Region bounds: first= last=1 2023-11-13 04:55:25,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HRegion(2446): Flush status journal for e13efa47a2338bfc8c25006e697a36d8: 2023-11-13 04:55:25,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41657] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-11-13 04:55:25,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41657] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-13 04:55:25,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231113/family1/501dd85b4ba04d71a5b0ab2d4bcfd10d to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testCompactionWithHFileLink__r5poc4c4evkbdffdp2v4mevqhm9bb62abs20ta57i8k11gkqpb8e2gah37fqe9ba/family1/501dd85b4ba04d71a5b0ab2d4bcfd10d 2023-11-13 04:55:25,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41657] regionserver.HRegion(2446): Flush status journal for 6638aa08a24bc6e34e9840c49e638c8a: 2023-11-13 04:55:25,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231113/family1/0c2954d3ad8441f9a05026122e26db50 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testCompactionWithHFileLink__3vs2l6svce9fqcjhidsmhurbec66506qdmgifobc02jm3g225qee4hfvf6v3vaqj/family1/0c2954d3ad8441f9a05026122e26db50 2023-11-13 04:55:25,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231113/family1/b63992f054834bf28afc7aeb58facbac to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testCompactionWithHFileLink__ch9l9i18ajdm17u2t1fpj36bcpao7b0dqotnrec0etmv7jjr1b7vppjhdakpilu3/family1/b63992f054834bf28afc7aeb58facbac 2023-11-13 04:55:25,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testCompactionWithHFileLink__r5poc4c4evkbdffdp2v4mevqhm9bb62abs20ta57i8k11gkqpb8e2gah37fqe9ba/family1/501dd85b4ba04d71a5b0ab2d4bcfd10d as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/91cad8d67c7e497c9fc1c01c7350542e_SeqId_35_ 2023-11-13 04:55:25,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testCompactionWithHFileLink__3vs2l6svce9fqcjhidsmhurbec66506qdmgifobc02jm3g225qee4hfvf6v3vaqj/family1/0c2954d3ad8441f9a05026122e26db50 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/9c580534644f4d00a27f6128cc17c5d8_SeqId_34_ 2023-11-13 04:55:25,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testCompactionWithHFileLink__ch9l9i18ajdm17u2t1fpj36bcpao7b0dqotnrec0etmv7jjr1b7vppjhdakpilu3/family1/b63992f054834bf28afc7aeb58facbac as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/c5e3ef015fd94be99f3b54337aefefff_SeqId_34_ 2023-11-13 04:55:25,459 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(849): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testCompactionWithHFileLink__r5poc4c4evkbdffdp2v4mevqhm9bb62abs20ta57i8k11gkqpb8e2gah37fqe9ba/family1/501dd85b4ba04d71a5b0ab2d4bcfd10d into bfeed2e88ce202cf921374d6d67968c7/family1 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/91cad8d67c7e497c9fc1c01c7350542e_SeqId_35_ - updating store file list. 2023-11-13 04:55:25,459 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(849): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testCompactionWithHFileLink__3vs2l6svce9fqcjhidsmhurbec66506qdmgifobc02jm3g225qee4hfvf6v3vaqj/family1/0c2954d3ad8441f9a05026122e26db50 into e13efa47a2338bfc8c25006e697a36d8/family1 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/9c580534644f4d00a27f6128cc17c5d8_SeqId_34_ - updating store file list. 2023-11-13 04:55:25,459 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41657] regionserver.HStore(849): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testCompactionWithHFileLink__ch9l9i18ajdm17u2t1fpj36bcpao7b0dqotnrec0etmv7jjr1b7vppjhdakpilu3/family1/b63992f054834bf28afc7aeb58facbac into 6638aa08a24bc6e34e9840c49e638c8a/family1 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/c5e3ef015fd94be99f3b54337aefefff_SeqId_34_ - updating store file list. 2023-11-13 04:55:25,465 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41657] regionserver.HStore(882): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/c5e3ef015fd94be99f3b54337aefefff_SeqId_34_ into 6638aa08a24bc6e34e9840c49e638c8a/family1 2023-11-13 04:55:25,465 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41657] regionserver.HStore(855): Successfully loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testCompactionWithHFileLink__ch9l9i18ajdm17u2t1fpj36bcpao7b0dqotnrec0etmv7jjr1b7vppjhdakpilu3/family1/b63992f054834bf28afc7aeb58facbac into 6638aa08a24bc6e34e9840c49e638c8a/family1 (new location: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/c5e3ef015fd94be99f3b54337aefefff_SeqId_34_) 2023-11-13 04:55:25,465 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(882): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/9c580534644f4d00a27f6128cc17c5d8_SeqId_34_ into e13efa47a2338bfc8c25006e697a36d8/family1 2023-11-13 04:55:25,465 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(855): Successfully loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testCompactionWithHFileLink__3vs2l6svce9fqcjhidsmhurbec66506qdmgifobc02jm3g225qee4hfvf6v3vaqj/family1/0c2954d3ad8441f9a05026122e26db50 into e13efa47a2338bfc8c25006e697a36d8/family1 (new location: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/9c580534644f4d00a27f6128cc17c5d8_SeqId_34_) 2023-11-13 04:55:25,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testCompactionWithHFileLink__ch9l9i18ajdm17u2t1fpj36bcpao7b0dqotnrec0etmv7jjr1b7vppjhdakpilu3/family1/b63992f054834bf28afc7aeb58facbac 2023-11-13 04:55:25,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testCompactionWithHFileLink__3vs2l6svce9fqcjhidsmhurbec66506qdmgifobc02jm3g225qee4hfvf6v3vaqj/family1/0c2954d3ad8441f9a05026122e26db50 2023-11-13 04:55:25,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-13 04:55:25,466 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(882): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/91cad8d67c7e497c9fc1c01c7350542e_SeqId_35_ into bfeed2e88ce202cf921374d6d67968c7/family1 2023-11-13 04:55:25,466 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(855): Successfully loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testCompactionWithHFileLink__r5poc4c4evkbdffdp2v4mevqhm9bb62abs20ta57i8k11gkqpb8e2gah37fqe9ba/family1/501dd85b4ba04d71a5b0ab2d4bcfd10d into bfeed2e88ce202cf921374d6d67968c7/family1 (new location: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family1/91cad8d67c7e497c9fc1c01c7350542e_SeqId_35_) 2023-11-13 04:55:25,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testCompactionWithHFileLink__r5poc4c4evkbdffdp2v4mevqhm9bb62abs20ta57i8k11gkqpb8e2gah37fqe9ba/family1/501dd85b4ba04d71a5b0ab2d4bcfd10d 2023-11-13 04:55:25,467 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231113 table='testCompactionWithHFileLink' column='family1' 2023-11-13 04:55:25,468 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:55:25,469 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231113 table='testCompactionWithHFileLink' column='family1' 2023-11-13 04:55:25,470 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023111343a962cdb9454855b1cba6892085e038 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023111343a962cdb9454855b1cba6892085e038 2023-11-13 04:55:25,470 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:55:25,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-11-13 04:55:25,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(1912): e13efa47a2338bfc8c25006e697a36d8/family1 is initiating minor compaction (all files) 2023-11-13 04:55:25,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4ad7c59b; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-11-13 04:55:25,471 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231113a01b6cba5f564864bf45c965c8cd4871 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231113a01b6cba5f564864bf45c965c8cd4871 2023-11-13 04:55:25,471 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202311137b3eadda4c934e8f9d523657a0b77183 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202311137b3eadda4c934e8f9d523657a0b77183 2023-11-13 04:55:25,473 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231113 table='testCompactionWithHFileLink' column='family1' 2023-11-13 04:55:25,473 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231113a253e2457d5f435ebee6f1ee36f55d25 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231113a253e2457d5f435ebee6f1ee36f55d25 2023-11-13 04:55:25,473 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231113c7bb0d4adb7e47fa816b3246d1d1523e to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231113c7bb0d4adb7e47fa816b3246d1d1523e 2023-11-13 04:55:25,473 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:55:25,475 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231113dd59155911b448159fdd1cef1c0b1083 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231113dd59155911b448159fdd1cef1c0b1083 2023-11-13 04:55:25,475 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231113f2f4bd37329a480bbfee9819afebc9a3 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231113f2f4bd37329a480bbfee9819afebc9a3 2023-11-13 04:55:25,475 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-13 04:55:25,475 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231113' 2023-11-13 04:55:25,475 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023111365f56168a30e4de6aa4908b7a0069dc8 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023111365f56168a30e4de6aa4908b7a0069dc8 2023-11-13 04:55:25,476 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231113 for table='testCompactionWithHFileLink' and column='family1' 2023-11-13 04:55:25,476 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231113f6671f6d9d62429f971e5c2dd1292622 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231113f6671f6d9d62429f971e5c2dd1292622 2023-11-13 04:55:25,476 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-13 04:55:25,476 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231113' 2023-11-13 04:55:25,477 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023111378016b094e234a4386415dae4a14c642 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023111378016b094e234a4386415dae4a14c642 2023-11-13 04:55:25,477 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231113 for table='testCompactionWithHFileLink' and column='family1' 2023-11-13 04:55:25,478 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023111382d6195e776e49da80fb040337f6e2f1 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023111382d6195e776e49da80fb040337f6e2f1 2023-11-13 04:55:25,479 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202311138a7e2bf3f47841619b334d10c3ce3fd4 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202311138a7e2bf3f47841619b334d10c3ce3fd4 2023-11-13 04:55:25,479 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-13 04:55:25,479 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231113' 2023-11-13 04:55:25,479 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231113 for table='testCompactionWithHFileLink' and column='family1' 2023-11-13 04:55:25,479 INFO [Listener at localhost/34517] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-11-13 04:55:25,482 DEBUG [Listener at localhost/34517] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-13 04:55:25,484 DEBUG [Listener at localhost/34517] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-13 04:55:25,491 DEBUG [Listener at localhost/34517] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-13 04:55:25,493 DEBUG [RS:0;jenkins-hbase4:41657-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/.tmp/family2/3c444034e7c04cf9af5cdb755cbe3722 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/3c444034e7c04cf9af5cdb755cbe3722 2023-11-13 04:55:25,494 DEBUG [Listener at localhost/34517] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-13 04:55:25,499 INFO [RS:0;jenkins-hbase4:41657-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in bfeed2e88ce202cf921374d6d67968c7/family2 of bfeed2e88ce202cf921374d6d67968c7 into 3c444034e7c04cf9af5cdb755cbe3722(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-13 04:55:25,499 DEBUG [RS:0;jenkins-hbase4:41657-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for bfeed2e88ce202cf921374d6d67968c7: 2023-11-13 04:55:25,499 INFO [RS:0;jenkins-hbase4:41657-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7., storeName=bfeed2e88ce202cf921374d6d67968c7/family2, priority=12, startTime=1699851324211; duration=1sec 2023-11-13 04:55:25,500 DEBUG [RS:0;jenkins-hbase4:41657-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-11-13 04:55:25,500 INFO [RS:0;jenkins-hbase4:41657-longCompactions-0] regionserver.HRegion(2259): Starting compaction of e13efa47a2338bfc8c25006e697a36d8/family1 in testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8. 2023-11-13 04:55:25,500 INFO [RS:0;jenkins-hbase4:41657-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/testCompactionWithHFileLink=e13efa47a2338bfc8c25006e697a36d8-390824bbfce04fd9ac1b935a17760523, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/testCompactionWithHFileLink=e13efa47a2338bfc8c25006e697a36d8-2ea41d0a5fc141e4ad3d775a051b52a4, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/testCompactionWithHFileLink=e13efa47a2338bfc8c25006e697a36d8-4e0fe736e59d4ea9950d123020a08137, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/testCompactionWithHFileLink=e13efa47a2338bfc8c25006e697a36d8-0b548a931acb440487d096ffaf5c6b41, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/9c580534644f4d00a27f6128cc17c5d8_SeqId_34_] into tmpdir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/.tmp, totalSize=28.9 K 2023-11-13 04:55:25,500 DEBUG [RS:0;jenkins-hbase4:41657-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=e13efa47a2338bfc8c25006e697a36d8-390824bbfce04fd9ac1b935a17760523, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699851302514 2023-11-13 04:55:25,501 DEBUG [RS:0;jenkins-hbase4:41657-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=e13efa47a2338bfc8c25006e697a36d8-2ea41d0a5fc141e4ad3d775a051b52a4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699851304294 2023-11-13 04:55:25,502 DEBUG [RS:0;jenkins-hbase4:41657-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=e13efa47a2338bfc8c25006e697a36d8-4e0fe736e59d4ea9950d123020a08137, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699851306113 2023-11-13 04:55:25,502 DEBUG [RS:0;jenkins-hbase4:41657-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=e13efa47a2338bfc8c25006e697a36d8-0b548a931acb440487d096ffaf5c6b41, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699851307908 2023-11-13 04:55:25,503 DEBUG [RS:0;jenkins-hbase4:41657-longCompactions-0] compactions.Compactor(207): Compacting 9c580534644f4d00a27f6128cc17c5d8_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1699851302514 2023-11-13 04:55:25,503 DEBUG [Listener at localhost/34517] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-13 04:55:25,504 DEBUG [Listener at localhost/34517] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-13 04:55:25,520 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/testCompactionWithHFileLink=bfeed2e88ce202cf921374d6d67968c7-8f39ca4d1f2047799898b9eb81767fb1, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/testCompactionWithHFileLink=bfeed2e88ce202cf921374d6d67968c7-46c6c9a3dbd045e8a34a53ced1c80592, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/testCompactionWithHFileLink=bfeed2e88ce202cf921374d6d67968c7-ed2295265451475b90c1bdcd90481da6, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/testCompactionWithHFileLink=bfeed2e88ce202cf921374d6d67968c7-c6aa2bd8bb014b1a9a42a050ee5af1d6] to archive 2023-11-13 04:55:25,520 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:55:25,522 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/testCompactionWithHFileLink=bfeed2e88ce202cf921374d6d67968c7-8f39ca4d1f2047799898b9eb81767fb1 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/testCompactionWithHFileLink=bfeed2e88ce202cf921374d6d67968c7-8f39ca4d1f2047799898b9eb81767fb1 2023-11-13 04:55:25,524 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/testCompactionWithHFileLink=bfeed2e88ce202cf921374d6d67968c7-46c6c9a3dbd045e8a34a53ced1c80592 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/testCompactionWithHFileLink=bfeed2e88ce202cf921374d6d67968c7-46c6c9a3dbd045e8a34a53ced1c80592 2023-11-13 04:55:25,525 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/testCompactionWithHFileLink=bfeed2e88ce202cf921374d6d67968c7-ed2295265451475b90c1bdcd90481da6 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/testCompactionWithHFileLink=bfeed2e88ce202cf921374d6d67968c7-ed2295265451475b90c1bdcd90481da6 2023-11-13 04:55:25,526 INFO [Listener at localhost/34517] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=289 (was 238) - Thread LEAK? -, OpenFileDescriptor=794 (was 619) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=132 (was 136), ProcessCount=167 (was 167), AvailableMemoryMB=2822 (was 2411) - AvailableMemoryMB LEAK? - 2023-11-13 04:55:25,531 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/testCompactionWithHFileLink=bfeed2e88ce202cf921374d6d67968c7-c6aa2bd8bb014b1a9a42a050ee5af1d6 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/family2/testCompactionWithHFileLink=bfeed2e88ce202cf921374d6d67968c7-c6aa2bd8bb014b1a9a42a050ee5af1d6 2023-11-13 04:55:25,540 INFO [Listener at localhost/34517] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=286, OpenFileDescriptor=788, MaxFileDescriptor=60000, SystemLoadAverage=132, ProcessCount=167, AvailableMemoryMB=2821 2023-11-13 04:55:25,545 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.HMaster$15(3014): Client=jenkins//172.31.14.131 creating {NAME => 'ns'} 2023-11-13 04:55:25,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-11-13 04:55:25,552 INFO [RS:0;jenkins-hbase4:41657-longCompactions-0] throttle.PressureAwareThroughputController(145): e13efa47a2338bfc8c25006e697a36d8#family1#compaction#116 average throughput is 0.18 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-13 04:55:25,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-11-13 04:55:25,557 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-13 04:55:25,560 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 10 msec 2023-11-13 04:55:25,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-11-13 04:55:25,657 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-13 04:55:25,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-11-13 04:55:25,659 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-11-13 04:55:25,659 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-11-13 04:55:25,660 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-13 04:55:25,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-13 04:55:25,662 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591 2023-11-13 04:55:25,662 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f 2023-11-13 04:55:25,662 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192 2023-11-13 04:55:25,662 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591 empty. 2023-11-13 04:55:25,662 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f empty. 2023-11-13 04:55:25,662 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192 empty. 2023-11-13 04:55:25,663 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591 2023-11-13 04:55:25,663 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192 2023-11-13 04:55:25,663 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f 2023-11-13 04:55:25,663 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-11-13 04:55:25,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-13 04:55:25,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-13 04:55:25,972 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/.tmp/family1/9c1b6d828b644571a7ff9c1c03ee945e as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/9c1b6d828b644571a7ff9c1c03ee945e 2023-11-13 04:55:25,976 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 6638aa08a24bc6e34e9840c49e638c8a/family1 of 6638aa08a24bc6e34e9840c49e638c8a into 9c1b6d828b644571a7ff9c1c03ee945e(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-13 04:55:25,976 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 6638aa08a24bc6e34e9840c49e638c8a: 2023-11-13 04:55:25,976 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a., storeName=6638aa08a24bc6e34e9840c49e638c8a/family1, priority=12, startTime=1699851324313; duration=0sec 2023-11-13 04:55:25,976 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-11-13 04:55:25,976 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-13 04:55:25,978 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-13 04:55:25,978 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HStore(1912): 6638aa08a24bc6e34e9840c49e638c8a/family2 is initiating minor compaction (all files) 2023-11-13 04:55:25,979 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 6638aa08a24bc6e34e9840c49e638c8a/family2 in testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a. 2023-11-13 04:55:25,979 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/testCompactionWithHFileLink=6638aa08a24bc6e34e9840c49e638c8a-86886665116d4ba293a13c09aedad26a, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/testCompactionWithHFileLink=6638aa08a24bc6e34e9840c49e638c8a-3a385363c38c493db398a3eeb8c23c45, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/testCompactionWithHFileLink=6638aa08a24bc6e34e9840c49e638c8a-9e729fa6d311473c96c179090d6b8367, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/testCompactionWithHFileLink=6638aa08a24bc6e34e9840c49e638c8a-f6fb49bb4ab442b39a424a889d8ab93e] into tmpdir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/.tmp, totalSize=20.4 K 2023-11-13 04:55:25,979 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=6638aa08a24bc6e34e9840c49e638c8a-86886665116d4ba293a13c09aedad26a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699851302515 2023-11-13 04:55:25,980 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=6638aa08a24bc6e34e9840c49e638c8a-3a385363c38c493db398a3eeb8c23c45, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699851304294 2023-11-13 04:55:25,980 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=6638aa08a24bc6e34e9840c49e638c8a-9e729fa6d311473c96c179090d6b8367, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699851306113 2023-11-13 04:55:25,981 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=6638aa08a24bc6e34e9840c49e638c8a-f6fb49bb4ab442b39a424a889d8ab93e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699851307908 2023-11-13 04:55:25,992 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] throttle.PressureAwareThroughputController(145): 6638aa08a24bc6e34e9840c49e638c8a#family2#compaction#117 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-13 04:55:26,024 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/testCompactionWithHFileLink=6638aa08a24bc6e34e9840c49e638c8a-12c93e792bf84957ac292148d77afa10, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/testCompactionWithHFileLink=6638aa08a24bc6e34e9840c49e638c8a-4a4345fbfaf544a4bca8220aa5491d91, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/testCompactionWithHFileLink=6638aa08a24bc6e34e9840c49e638c8a-9db28e991279470d84afb14894901a51, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/testCompactionWithHFileLink=6638aa08a24bc6e34e9840c49e638c8a-08fde853956a475e89743233b5800da0] to archive 2023-11-13 04:55:26,025 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:55:26,026 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/testCompactionWithHFileLink=6638aa08a24bc6e34e9840c49e638c8a-12c93e792bf84957ac292148d77afa10 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/testCompactionWithHFileLink=6638aa08a24bc6e34e9840c49e638c8a-12c93e792bf84957ac292148d77afa10 2023-11-13 04:55:26,027 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/testCompactionWithHFileLink=6638aa08a24bc6e34e9840c49e638c8a-4a4345fbfaf544a4bca8220aa5491d91 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/testCompactionWithHFileLink=6638aa08a24bc6e34e9840c49e638c8a-4a4345fbfaf544a4bca8220aa5491d91 2023-11-13 04:55:26,028 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/testCompactionWithHFileLink=6638aa08a24bc6e34e9840c49e638c8a-9db28e991279470d84afb14894901a51 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/testCompactionWithHFileLink=6638aa08a24bc6e34e9840c49e638c8a-9db28e991279470d84afb14894901a51 2023-11-13 04:55:26,029 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/testCompactionWithHFileLink=6638aa08a24bc6e34e9840c49e638c8a-08fde853956a475e89743233b5800da0 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family1/testCompactionWithHFileLink=6638aa08a24bc6e34e9840c49e638c8a-08fde853956a475e89743233b5800da0 2023-11-13 04:55:26,069 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-11-13 04:55:26,071 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7675): creating {ENCODED => 93b1e59720a53a032a804bf4ec0ce192, NAME => 'ns:testMinorCompaction,2,1699851325657.93b1e59720a53a032a804bf4ec0ce192.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp 2023-11-13 04:55:26,071 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => beccf4b9bb7f1b9d4214b816ec12c591, NAME => 'ns:testMinorCompaction,,1699851325657.beccf4b9bb7f1b9d4214b816ec12c591.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp 2023-11-13 04:55:26,071 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7675): creating {ENCODED => 69269bc0d44ad4030e108151ca591d2f, NAME => 'ns:testMinorCompaction,1,1699851325657.69269bc0d44ad4030e108151ca591d2f.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp 2023-11-13 04:55:26,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-13 04:55:26,379 DEBUG [RS:0;jenkins-hbase4:41657-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/.tmp/family1/1f5d1dc61d734e44a783b131867888c4 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/1f5d1dc61d734e44a783b131867888c4 2023-11-13 04:55:26,383 INFO [RS:0;jenkins-hbase4:41657-longCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in e13efa47a2338bfc8c25006e697a36d8/family1 of e13efa47a2338bfc8c25006e697a36d8 into 1f5d1dc61d734e44a783b131867888c4(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-13 04:55:26,383 DEBUG [RS:0;jenkins-hbase4:41657-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for e13efa47a2338bfc8c25006e697a36d8: 2023-11-13 04:55:26,383 INFO [RS:0;jenkins-hbase4:41657-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1699851325470; duration=0sec 2023-11-13 04:55:26,384 DEBUG [RS:0;jenkins-hbase4:41657-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-11-13 04:55:26,384 DEBUG [RS:0;jenkins-hbase4:41657-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-13 04:55:26,386 DEBUG [RS:0;jenkins-hbase4:41657-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-13 04:55:26,386 DEBUG [RS:0;jenkins-hbase4:41657-longCompactions-0] regionserver.HStore(1912): e13efa47a2338bfc8c25006e697a36d8/family2 is initiating minor compaction (all files) 2023-11-13 04:55:26,386 INFO [RS:0;jenkins-hbase4:41657-longCompactions-0] regionserver.HRegion(2259): Starting compaction of e13efa47a2338bfc8c25006e697a36d8/family2 in testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8. 2023-11-13 04:55:26,386 INFO [RS:0;jenkins-hbase4:41657-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/testCompactionWithHFileLink=e13efa47a2338bfc8c25006e697a36d8-425709ac686d4a6599e4146cbc4e1457, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/testCompactionWithHFileLink=e13efa47a2338bfc8c25006e697a36d8-719456a418b4436fa26acb297228e658, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/testCompactionWithHFileLink=e13efa47a2338bfc8c25006e697a36d8-52d64f3aa1c842828ad355d41c232a9a, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/testCompactionWithHFileLink=e13efa47a2338bfc8c25006e697a36d8-d7c4c89b37e547b6a119da3fe0471bf1] into tmpdir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/.tmp, totalSize=20.4 K 2023-11-13 04:55:26,386 DEBUG [RS:0;jenkins-hbase4:41657-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=e13efa47a2338bfc8c25006e697a36d8-425709ac686d4a6599e4146cbc4e1457, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699851302514 2023-11-13 04:55:26,387 DEBUG [RS:0;jenkins-hbase4:41657-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=e13efa47a2338bfc8c25006e697a36d8-719456a418b4436fa26acb297228e658, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699851304294 2023-11-13 04:55:26,387 DEBUG [RS:0;jenkins-hbase4:41657-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=e13efa47a2338bfc8c25006e697a36d8-52d64f3aa1c842828ad355d41c232a9a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699851306113 2023-11-13 04:55:26,388 DEBUG [RS:0;jenkins-hbase4:41657-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=e13efa47a2338bfc8c25006e697a36d8-d7c4c89b37e547b6a119da3fe0471bf1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699851307908 2023-11-13 04:55:26,399 INFO [RS:0;jenkins-hbase4:41657-longCompactions-0] throttle.PressureAwareThroughputController(145): e13efa47a2338bfc8c25006e697a36d8#family2#compaction#118 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-13 04:55:26,406 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/.tmp/family2/d8c2d723e7e64f41b644b89fb1e87217 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/d8c2d723e7e64f41b644b89fb1e87217 2023-11-13 04:55:26,410 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 6638aa08a24bc6e34e9840c49e638c8a/family2 of 6638aa08a24bc6e34e9840c49e638c8a into d8c2d723e7e64f41b644b89fb1e87217(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-13 04:55:26,410 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 6638aa08a24bc6e34e9840c49e638c8a: 2023-11-13 04:55:26,410 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a., storeName=6638aa08a24bc6e34e9840c49e638c8a/family2, priority=12, startTime=1699851324313; duration=0sec 2023-11-13 04:55:26,410 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-11-13 04:55:26,410 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-11-13 04:55:26,410 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-11-13 04:55:26,411 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-11-13 04:55:26,411 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8. because compaction request was cancelled 2023-11-13 04:55:26,421 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/testCompactionWithHFileLink=6638aa08a24bc6e34e9840c49e638c8a-86886665116d4ba293a13c09aedad26a, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/testCompactionWithHFileLink=6638aa08a24bc6e34e9840c49e638c8a-3a385363c38c493db398a3eeb8c23c45, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/testCompactionWithHFileLink=6638aa08a24bc6e34e9840c49e638c8a-9e729fa6d311473c96c179090d6b8367, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/testCompactionWithHFileLink=6638aa08a24bc6e34e9840c49e638c8a-f6fb49bb4ab442b39a424a889d8ab93e] to archive 2023-11-13 04:55:26,421 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:55:26,423 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/testCompactionWithHFileLink=6638aa08a24bc6e34e9840c49e638c8a-86886665116d4ba293a13c09aedad26a to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/testCompactionWithHFileLink=6638aa08a24bc6e34e9840c49e638c8a-86886665116d4ba293a13c09aedad26a 2023-11-13 04:55:26,424 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/testCompactionWithHFileLink=6638aa08a24bc6e34e9840c49e638c8a-3a385363c38c493db398a3eeb8c23c45 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/testCompactionWithHFileLink=6638aa08a24bc6e34e9840c49e638c8a-3a385363c38c493db398a3eeb8c23c45 2023-11-13 04:55:26,425 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/testCompactionWithHFileLink=6638aa08a24bc6e34e9840c49e638c8a-9e729fa6d311473c96c179090d6b8367 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/testCompactionWithHFileLink=6638aa08a24bc6e34e9840c49e638c8a-9e729fa6d311473c96c179090d6b8367 2023-11-13 04:55:26,426 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/testCompactionWithHFileLink=6638aa08a24bc6e34e9840c49e638c8a-f6fb49bb4ab442b39a424a889d8ab93e to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/family2/testCompactionWithHFileLink=6638aa08a24bc6e34e9840c49e638c8a-f6fb49bb4ab442b39a424a889d8ab93e 2023-11-13 04:55:26,427 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/testCompactionWithHFileLink=e13efa47a2338bfc8c25006e697a36d8-390824bbfce04fd9ac1b935a17760523, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/testCompactionWithHFileLink=e13efa47a2338bfc8c25006e697a36d8-2ea41d0a5fc141e4ad3d775a051b52a4, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/testCompactionWithHFileLink=e13efa47a2338bfc8c25006e697a36d8-4e0fe736e59d4ea9950d123020a08137, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/testCompactionWithHFileLink=e13efa47a2338bfc8c25006e697a36d8-0b548a931acb440487d096ffaf5c6b41, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/9c580534644f4d00a27f6128cc17c5d8_SeqId_34_] to archive 2023-11-13 04:55:26,428 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:55:26,429 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/testCompactionWithHFileLink=e13efa47a2338bfc8c25006e697a36d8-390824bbfce04fd9ac1b935a17760523 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/testCompactionWithHFileLink=e13efa47a2338bfc8c25006e697a36d8-390824bbfce04fd9ac1b935a17760523 2023-11-13 04:55:26,430 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/testCompactionWithHFileLink=e13efa47a2338bfc8c25006e697a36d8-2ea41d0a5fc141e4ad3d775a051b52a4 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/testCompactionWithHFileLink=e13efa47a2338bfc8c25006e697a36d8-2ea41d0a5fc141e4ad3d775a051b52a4 2023-11-13 04:55:26,431 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/testCompactionWithHFileLink=e13efa47a2338bfc8c25006e697a36d8-4e0fe736e59d4ea9950d123020a08137 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/testCompactionWithHFileLink=e13efa47a2338bfc8c25006e697a36d8-4e0fe736e59d4ea9950d123020a08137 2023-11-13 04:55:26,432 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/testCompactionWithHFileLink=e13efa47a2338bfc8c25006e697a36d8-0b548a931acb440487d096ffaf5c6b41 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/testCompactionWithHFileLink=e13efa47a2338bfc8c25006e697a36d8-0b548a931acb440487d096ffaf5c6b41 2023-11-13 04:55:26,432 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/9c580534644f4d00a27f6128cc17c5d8_SeqId_34_ to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family1/9c580534644f4d00a27f6128cc17c5d8_SeqId_34_ 2023-11-13 04:55:26,438 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-13 04:55:26,476 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1699851325657.93b1e59720a53a032a804bf4ec0ce192.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-13 04:55:26,476 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1699851325657.beccf4b9bb7f1b9d4214b816ec12c591.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-13 04:55:26,476 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1604): Closing 93b1e59720a53a032a804bf4ec0ce192, disabling compactions & flushes 2023-11-13 04:55:26,476 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1604): Closing beccf4b9bb7f1b9d4214b816ec12c591, disabling compactions & flushes 2023-11-13 04:55:26,476 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1699851325657.93b1e59720a53a032a804bf4ec0ce192. 2023-11-13 04:55:26,477 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1699851325657.beccf4b9bb7f1b9d4214b816ec12c591. 2023-11-13 04:55:26,477 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1699851325657.93b1e59720a53a032a804bf4ec0ce192. 2023-11-13 04:55:26,477 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1699851325657.beccf4b9bb7f1b9d4214b816ec12c591. 2023-11-13 04:55:26,477 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1699851325657.69269bc0d44ad4030e108151ca591d2f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-13 04:55:26,477 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1699851325657.93b1e59720a53a032a804bf4ec0ce192. after waiting 0 ms 2023-11-13 04:55:26,477 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1604): Closing 69269bc0d44ad4030e108151ca591d2f, disabling compactions & flushes 2023-11-13 04:55:26,477 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1699851325657.93b1e59720a53a032a804bf4ec0ce192. 2023-11-13 04:55:26,477 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1699851325657.beccf4b9bb7f1b9d4214b816ec12c591. after waiting 0 ms 2023-11-13 04:55:26,477 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1699851325657.93b1e59720a53a032a804bf4ec0ce192. 2023-11-13 04:55:26,477 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1699851325657.69269bc0d44ad4030e108151ca591d2f. 2023-11-13 04:55:26,477 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1558): Region close journal for 93b1e59720a53a032a804bf4ec0ce192: 2023-11-13 04:55:26,477 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1699851325657.beccf4b9bb7f1b9d4214b816ec12c591. 2023-11-13 04:55:26,477 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1699851325657.69269bc0d44ad4030e108151ca591d2f. 2023-11-13 04:55:26,477 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1699851325657.beccf4b9bb7f1b9d4214b816ec12c591. 2023-11-13 04:55:26,477 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1699851325657.69269bc0d44ad4030e108151ca591d2f. after waiting 0 ms 2023-11-13 04:55:26,477 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1699851325657.69269bc0d44ad4030e108151ca591d2f. 2023-11-13 04:55:26,477 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1558): Region close journal for beccf4b9bb7f1b9d4214b816ec12c591: 2023-11-13 04:55:26,477 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1699851325657.69269bc0d44ad4030e108151ca591d2f. 2023-11-13 04:55:26,477 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1558): Region close journal for 69269bc0d44ad4030e108151ca591d2f: 2023-11-13 04:55:26,479 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-11-13 04:55:26,480 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1699851325657.93b1e59720a53a032a804bf4ec0ce192.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1699851326480"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699851326480"}]},"ts":"1699851326480"} 2023-11-13 04:55:26,480 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1699851325657.beccf4b9bb7f1b9d4214b816ec12c591.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1699851326480"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699851326480"}]},"ts":"1699851326480"} 2023-11-13 04:55:26,480 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1699851325657.69269bc0d44ad4030e108151ca591d2f.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1699851326480"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699851326480"}]},"ts":"1699851326480"} 2023-11-13 04:55:26,482 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-13 04:55:26,482 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-13 04:55:26,482 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699851326482"}]},"ts":"1699851326482"} 2023-11-13 04:55:26,483 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-11-13 04:55:26,493 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=beccf4b9bb7f1b9d4214b816ec12c591, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=69269bc0d44ad4030e108151ca591d2f, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=93b1e59720a53a032a804bf4ec0ce192, ASSIGN}] 2023-11-13 04:55:26,494 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=69269bc0d44ad4030e108151ca591d2f, ASSIGN 2023-11-13 04:55:26,494 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=beccf4b9bb7f1b9d4214b816ec12c591, ASSIGN 2023-11-13 04:55:26,494 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=93b1e59720a53a032a804bf4ec0ce192, ASSIGN 2023-11-13 04:55:26,495 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=69269bc0d44ad4030e108151ca591d2f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41657,1699851201532; forceNewPlan=false, retain=false 2023-11-13 04:55:26,495 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=beccf4b9bb7f1b9d4214b816ec12c591, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41657,1699851201532; forceNewPlan=false, retain=false 2023-11-13 04:55:26,495 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=93b1e59720a53a032a804bf4ec0ce192, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41657,1699851201532; forceNewPlan=false, retain=false 2023-11-13 04:55:26,647 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=93b1e59720a53a032a804bf4ec0ce192, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:26,647 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=69269bc0d44ad4030e108151ca591d2f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:26,647 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=beccf4b9bb7f1b9d4214b816ec12c591, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:26,648 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1699851325657.93b1e59720a53a032a804bf4ec0ce192.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1699851326647"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699851326647"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699851326647"}]},"ts":"1699851326647"} 2023-11-13 04:55:26,648 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1699851325657.beccf4b9bb7f1b9d4214b816ec12c591.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1699851326647"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699851326647"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699851326647"}]},"ts":"1699851326647"} 2023-11-13 04:55:26,648 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1699851325657.69269bc0d44ad4030e108151ca591d2f.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1699851326647"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699851326647"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699851326647"}]},"ts":"1699851326647"} 2023-11-13 04:55:26,649 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=108, state=RUNNABLE; OpenRegionProcedure 93b1e59720a53a032a804bf4ec0ce192, server=jenkins-hbase4.apache.org,41657,1699851201532}] 2023-11-13 04:55:26,649 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=110, ppid=106, state=RUNNABLE; OpenRegionProcedure beccf4b9bb7f1b9d4214b816ec12c591, server=jenkins-hbase4.apache.org,41657,1699851201532}] 2023-11-13 04:55:26,650 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=111, ppid=107, state=RUNNABLE; OpenRegionProcedure 69269bc0d44ad4030e108151ca591d2f, server=jenkins-hbase4.apache.org,41657,1699851201532}] 2023-11-13 04:55:26,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-13 04:55:26,801 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:26,803 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,2,1699851325657.93b1e59720a53a032a804bf4ec0ce192. 2023-11-13 04:55:26,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 93b1e59720a53a032a804bf4ec0ce192, NAME => 'ns:testMinorCompaction,2,1699851325657.93b1e59720a53a032a804bf4ec0ce192.', STARTKEY => '2', ENDKEY => ''} 2023-11-13 04:55:26,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 93b1e59720a53a032a804bf4ec0ce192 2023-11-13 04:55:26,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1699851325657.93b1e59720a53a032a804bf4ec0ce192.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-13 04:55:26,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 93b1e59720a53a032a804bf4ec0ce192 2023-11-13 04:55:26,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 93b1e59720a53a032a804bf4ec0ce192 2023-11-13 04:55:26,805 INFO [StoreOpener-93b1e59720a53a032a804bf4ec0ce192-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 93b1e59720a53a032a804bf4ec0ce192 2023-11-13 04:55:26,806 DEBUG [StoreOpener-93b1e59720a53a032a804bf4ec0ce192-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family1 2023-11-13 04:55:26,806 DEBUG [StoreOpener-93b1e59720a53a032a804bf4ec0ce192-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family1 2023-11-13 04:55:26,807 INFO [StoreOpener-93b1e59720a53a032a804bf4ec0ce192-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 93b1e59720a53a032a804bf4ec0ce192 columnFamilyName family1 2023-11-13 04:55:26,808 INFO [StoreOpener-93b1e59720a53a032a804bf4ec0ce192-1] regionserver.HStore(310): Store=93b1e59720a53a032a804bf4ec0ce192/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-13 04:55:26,808 INFO [StoreOpener-93b1e59720a53a032a804bf4ec0ce192-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 93b1e59720a53a032a804bf4ec0ce192 2023-11-13 04:55:26,809 DEBUG [StoreOpener-93b1e59720a53a032a804bf4ec0ce192-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family2 2023-11-13 04:55:26,809 DEBUG [StoreOpener-93b1e59720a53a032a804bf4ec0ce192-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family2 2023-11-13 04:55:26,809 INFO [StoreOpener-93b1e59720a53a032a804bf4ec0ce192-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 93b1e59720a53a032a804bf4ec0ce192 columnFamilyName family2 2023-11-13 04:55:26,811 INFO [StoreOpener-93b1e59720a53a032a804bf4ec0ce192-1] regionserver.HStore(310): Store=93b1e59720a53a032a804bf4ec0ce192/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-13 04:55:26,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192 2023-11-13 04:55:26,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192 2023-11-13 04:55:26,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-13 04:55:26,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 93b1e59720a53a032a804bf4ec0ce192 2023-11-13 04:55:26,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-13 04:55:26,816 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 93b1e59720a53a032a804bf4ec0ce192; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61763587, jitterRate=-0.07965083420276642}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-13 04:55:26,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 93b1e59720a53a032a804bf4ec0ce192: 2023-11-13 04:55:26,817 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,2,1699851325657.93b1e59720a53a032a804bf4ec0ce192., pid=109, masterSystemTime=1699851326801 2023-11-13 04:55:26,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,2,1699851325657.93b1e59720a53a032a804bf4ec0ce192. 2023-11-13 04:55:26,818 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,2,1699851325657.93b1e59720a53a032a804bf4ec0ce192. 2023-11-13 04:55:26,818 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,1,1699851325657.69269bc0d44ad4030e108151ca591d2f. 2023-11-13 04:55:26,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 69269bc0d44ad4030e108151ca591d2f, NAME => 'ns:testMinorCompaction,1,1699851325657.69269bc0d44ad4030e108151ca591d2f.', STARTKEY => '1', ENDKEY => '2'} 2023-11-13 04:55:26,819 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=93b1e59720a53a032a804bf4ec0ce192, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:26,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 69269bc0d44ad4030e108151ca591d2f 2023-11-13 04:55:26,819 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1699851325657.93b1e59720a53a032a804bf4ec0ce192.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1699851326818"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699851326818"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699851326818"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699851326818"}]},"ts":"1699851326818"} 2023-11-13 04:55:26,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1699851325657.69269bc0d44ad4030e108151ca591d2f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-13 04:55:26,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 69269bc0d44ad4030e108151ca591d2f 2023-11-13 04:55:26,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 69269bc0d44ad4030e108151ca591d2f 2023-11-13 04:55:26,820 INFO [StoreOpener-69269bc0d44ad4030e108151ca591d2f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 69269bc0d44ad4030e108151ca591d2f 2023-11-13 04:55:26,821 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=108 2023-11-13 04:55:26,821 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=108, state=SUCCESS; OpenRegionProcedure 93b1e59720a53a032a804bf4ec0ce192, server=jenkins-hbase4.apache.org,41657,1699851201532 in 171 msec 2023-11-13 04:55:26,822 DEBUG [StoreOpener-69269bc0d44ad4030e108151ca591d2f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family1 2023-11-13 04:55:26,822 DEBUG [StoreOpener-69269bc0d44ad4030e108151ca591d2f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family1 2023-11-13 04:55:26,822 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=93b1e59720a53a032a804bf4ec0ce192, ASSIGN in 328 msec 2023-11-13 04:55:26,822 INFO [StoreOpener-69269bc0d44ad4030e108151ca591d2f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 69269bc0d44ad4030e108151ca591d2f columnFamilyName family1 2023-11-13 04:55:26,823 DEBUG [RS:0;jenkins-hbase4:41657-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/.tmp/family2/04b7dab35af34998af80d79a2834c46f as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/04b7dab35af34998af80d79a2834c46f 2023-11-13 04:55:26,823 INFO [StoreOpener-69269bc0d44ad4030e108151ca591d2f-1] regionserver.HStore(310): Store=69269bc0d44ad4030e108151ca591d2f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-13 04:55:26,824 INFO [StoreOpener-69269bc0d44ad4030e108151ca591d2f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 69269bc0d44ad4030e108151ca591d2f 2023-11-13 04:55:26,825 DEBUG [StoreOpener-69269bc0d44ad4030e108151ca591d2f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family2 2023-11-13 04:55:26,825 DEBUG [StoreOpener-69269bc0d44ad4030e108151ca591d2f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family2 2023-11-13 04:55:26,825 INFO [StoreOpener-69269bc0d44ad4030e108151ca591d2f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 69269bc0d44ad4030e108151ca591d2f columnFamilyName family2 2023-11-13 04:55:26,826 INFO [StoreOpener-69269bc0d44ad4030e108151ca591d2f-1] regionserver.HStore(310): Store=69269bc0d44ad4030e108151ca591d2f/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-13 04:55:26,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f 2023-11-13 04:55:26,827 INFO [RS:0;jenkins-hbase4:41657-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in e13efa47a2338bfc8c25006e697a36d8/family2 of e13efa47a2338bfc8c25006e697a36d8 into 04b7dab35af34998af80d79a2834c46f(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-13 04:55:26,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f 2023-11-13 04:55:26,827 DEBUG [RS:0;jenkins-hbase4:41657-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for e13efa47a2338bfc8c25006e697a36d8: 2023-11-13 04:55:26,827 INFO [RS:0;jenkins-hbase4:41657-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8., storeName=e13efa47a2338bfc8c25006e697a36d8/family2, priority=12, startTime=1699851324371; duration=0sec 2023-11-13 04:55:26,827 DEBUG [RS:0;jenkins-hbase4:41657-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-13 04:55:26,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-13 04:55:26,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 69269bc0d44ad4030e108151ca591d2f 2023-11-13 04:55:26,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-13 04:55:26,831 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 69269bc0d44ad4030e108151ca591d2f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69632379, jitterRate=0.03760330379009247}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-13 04:55:26,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 69269bc0d44ad4030e108151ca591d2f: 2023-11-13 04:55:26,831 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,1,1699851325657.69269bc0d44ad4030e108151ca591d2f., pid=111, masterSystemTime=1699851326801 2023-11-13 04:55:26,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,1,1699851325657.69269bc0d44ad4030e108151ca591d2f. 2023-11-13 04:55:26,832 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,1,1699851325657.69269bc0d44ad4030e108151ca591d2f. 2023-11-13 04:55:26,832 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,,1699851325657.beccf4b9bb7f1b9d4214b816ec12c591. 2023-11-13 04:55:26,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => beccf4b9bb7f1b9d4214b816ec12c591, NAME => 'ns:testMinorCompaction,,1699851325657.beccf4b9bb7f1b9d4214b816ec12c591.', STARTKEY => '', ENDKEY => '1'} 2023-11-13 04:55:26,832 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=69269bc0d44ad4030e108151ca591d2f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:26,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction beccf4b9bb7f1b9d4214b816ec12c591 2023-11-13 04:55:26,833 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1699851325657.69269bc0d44ad4030e108151ca591d2f.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1699851326832"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699851326832"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699851326832"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699851326832"}]},"ts":"1699851326832"} 2023-11-13 04:55:26,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1699851325657.beccf4b9bb7f1b9d4214b816ec12c591.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-13 04:55:26,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for beccf4b9bb7f1b9d4214b816ec12c591 2023-11-13 04:55:26,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for beccf4b9bb7f1b9d4214b816ec12c591 2023-11-13 04:55:26,834 INFO [StoreOpener-beccf4b9bb7f1b9d4214b816ec12c591-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region beccf4b9bb7f1b9d4214b816ec12c591 2023-11-13 04:55:26,835 DEBUG [StoreOpener-beccf4b9bb7f1b9d4214b816ec12c591-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family1 2023-11-13 04:55:26,835 DEBUG [StoreOpener-beccf4b9bb7f1b9d4214b816ec12c591-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family1 2023-11-13 04:55:26,835 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=111, resume processing ppid=107 2023-11-13 04:55:26,835 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=111, ppid=107, state=SUCCESS; OpenRegionProcedure 69269bc0d44ad4030e108151ca591d2f, server=jenkins-hbase4.apache.org,41657,1699851201532 in 184 msec 2023-11-13 04:55:26,835 INFO [StoreOpener-beccf4b9bb7f1b9d4214b816ec12c591-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region beccf4b9bb7f1b9d4214b816ec12c591 columnFamilyName family1 2023-11-13 04:55:26,836 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=69269bc0d44ad4030e108151ca591d2f, ASSIGN in 342 msec 2023-11-13 04:55:26,836 INFO [StoreOpener-beccf4b9bb7f1b9d4214b816ec12c591-1] regionserver.HStore(310): Store=beccf4b9bb7f1b9d4214b816ec12c591/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-13 04:55:26,836 INFO [StoreOpener-beccf4b9bb7f1b9d4214b816ec12c591-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region beccf4b9bb7f1b9d4214b816ec12c591 2023-11-13 04:55:26,837 DEBUG [StoreOpener-beccf4b9bb7f1b9d4214b816ec12c591-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family2 2023-11-13 04:55:26,837 DEBUG [StoreOpener-beccf4b9bb7f1b9d4214b816ec12c591-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family2 2023-11-13 04:55:26,838 INFO [StoreOpener-beccf4b9bb7f1b9d4214b816ec12c591-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region beccf4b9bb7f1b9d4214b816ec12c591 columnFamilyName family2 2023-11-13 04:55:26,838 INFO [StoreOpener-beccf4b9bb7f1b9d4214b816ec12c591-1] regionserver.HStore(310): Store=beccf4b9bb7f1b9d4214b816ec12c591/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-13 04:55:26,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591 2023-11-13 04:55:26,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591 2023-11-13 04:55:26,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-13 04:55:26,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for beccf4b9bb7f1b9d4214b816ec12c591 2023-11-13 04:55:26,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-13 04:55:26,843 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened beccf4b9bb7f1b9d4214b816ec12c591; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74275840, jitterRate=0.1067962646484375}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-13 04:55:26,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for beccf4b9bb7f1b9d4214b816ec12c591: 2023-11-13 04:55:26,843 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,,1699851325657.beccf4b9bb7f1b9d4214b816ec12c591., pid=110, masterSystemTime=1699851326801 2023-11-13 04:55:26,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,,1699851325657.beccf4b9bb7f1b9d4214b816ec12c591. 2023-11-13 04:55:26,845 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,,1699851325657.beccf4b9bb7f1b9d4214b816ec12c591. 2023-11-13 04:55:26,845 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=beccf4b9bb7f1b9d4214b816ec12c591, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:26,845 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1699851325657.beccf4b9bb7f1b9d4214b816ec12c591.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1699851326845"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699851326845"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699851326845"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699851326845"}]},"ts":"1699851326845"} 2023-11-13 04:55:26,847 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=110, resume processing ppid=106 2023-11-13 04:55:26,847 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=110, ppid=106, state=SUCCESS; OpenRegionProcedure beccf4b9bb7f1b9d4214b816ec12c591, server=jenkins-hbase4.apache.org,41657,1699851201532 in 197 msec 2023-11-13 04:55:26,848 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=106, resume processing ppid=105 2023-11-13 04:55:26,848 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=beccf4b9bb7f1b9d4214b816ec12c591, ASSIGN in 354 msec 2023-11-13 04:55:26,849 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-13 04:55:26,849 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699851326849"}]},"ts":"1699851326849"} 2023-11-13 04:55:26,850 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-11-13 04:55:26,852 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-11-13 04:55:26,853 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.1950 sec 2023-11-13 04:55:26,914 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/testCompactionWithHFileLink=e13efa47a2338bfc8c25006e697a36d8-425709ac686d4a6599e4146cbc4e1457, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/testCompactionWithHFileLink=e13efa47a2338bfc8c25006e697a36d8-719456a418b4436fa26acb297228e658, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/testCompactionWithHFileLink=e13efa47a2338bfc8c25006e697a36d8-52d64f3aa1c842828ad355d41c232a9a, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/testCompactionWithHFileLink=e13efa47a2338bfc8c25006e697a36d8-d7c4c89b37e547b6a119da3fe0471bf1] to archive 2023-11-13 04:55:26,915 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:55:26,917 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/testCompactionWithHFileLink=e13efa47a2338bfc8c25006e697a36d8-425709ac686d4a6599e4146cbc4e1457 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/testCompactionWithHFileLink=e13efa47a2338bfc8c25006e697a36d8-425709ac686d4a6599e4146cbc4e1457 2023-11-13 04:55:26,918 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/testCompactionWithHFileLink=e13efa47a2338bfc8c25006e697a36d8-719456a418b4436fa26acb297228e658 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/testCompactionWithHFileLink=e13efa47a2338bfc8c25006e697a36d8-719456a418b4436fa26acb297228e658 2023-11-13 04:55:26,919 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/testCompactionWithHFileLink=e13efa47a2338bfc8c25006e697a36d8-52d64f3aa1c842828ad355d41c232a9a to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/testCompactionWithHFileLink=e13efa47a2338bfc8c25006e697a36d8-52d64f3aa1c842828ad355d41c232a9a 2023-11-13 04:55:26,920 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/testCompactionWithHFileLink=e13efa47a2338bfc8c25006e697a36d8-d7c4c89b37e547b6a119da3fe0471bf1 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/family2/testCompactionWithHFileLink=e13efa47a2338bfc8c25006e697a36d8-d7c4c89b37e547b6a119da3fe0471bf1 2023-11-13 04:55:27,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-13 04:55:27,766 INFO [Listener at localhost/34517] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-11-13 04:55:27,771 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1699851325657.beccf4b9bb7f1b9d4214b816ec12c591. with WAL disabled. Data may be lost in the event of a crash. 2023-11-13 04:55:27,772 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1699851325657.69269bc0d44ad4030e108151ca591d2f. with WAL disabled. Data may be lost in the event of a crash. 2023-11-13 04:55:27,772 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1699851325657.93b1e59720a53a032a804bf4ec0ce192. with WAL disabled. Data may be lost in the event of a crash. 2023-11-13 04:55:27,774 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:55:27,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-13 04:55:27,775 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-13 04:55:27,776 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:55:27,776 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-13 04:55:27,776 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-13 04:55:27,776 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-13 04:55:27,776 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-13 04:55:27,778 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:27,778 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:55:27,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:55:27,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:55:27,778 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:27,778 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:55:27,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-13 04:55:27,778 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-13 04:55:27,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:55:27,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-13 04:55:27,779 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-13 04:55:27,779 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-13 04:55:27,779 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-13 04:55:27,779 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:55:27,779 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-13 04:55:27,780 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1699851325657.beccf4b9bb7f1b9d4214b816ec12c591. 2023-11-13 04:55:27,780 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1699851325657.69269bc0d44ad4030e108151ca591d2f. 2023-11-13 04:55:27,780 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1699851325657.beccf4b9bb7f1b9d4214b816ec12c591. started... 2023-11-13 04:55:27,780 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1699851325657.69269bc0d44ad4030e108151ca591d2f. started... 2023-11-13 04:55:27,780 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-13 04:55:27,780 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1699851325657.93b1e59720a53a032a804bf4ec0ce192. 2023-11-13 04:55:27,782 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 69269bc0d44ad4030e108151ca591d2f 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-13 04:55:27,780 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:55:27,782 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1699851325657.93b1e59720a53a032a804bf4ec0ce192. started... 2023-11-13 04:55:27,782 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing beccf4b9bb7f1b9d4214b816ec12c591 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-13 04:55:27,782 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 93b1e59720a53a032a804bf4ec0ce192 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-13 04:55:28,205 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023111351b8c4022a1a45c090be6b8974d06337 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023111351b8c4022a1a45c090be6b8974d06337 2023-11-13 04:55:28,205 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231113649f06c3635c42569a6b69fc9418ee78 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231113649f06c3635c42569a6b69fc9418ee78 2023-11-13 04:55:28,205 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311135e48814824be4072a43b765f2e9ed49f to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202311135e48814824be4072a43b765f2e9ed49f 2023-11-13 04:55:28,611 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/.tmp/family1/30450d58c37146cfa37a0d92be436333 2023-11-13 04:55:28,611 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/.tmp/family1/35a39da917fb42e892f42cc0b0a8caa2 2023-11-13 04:55:28,611 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/.tmp/family1/d893498a26aa4ec994b186037f8d8c00 2023-11-13 04:55:28,860 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-11-13 04:55:29,026 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311136893c72f3e0d48ef9595ee79969a4776 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202311136893c72f3e0d48ef9595ee79969a4776 2023-11-13 04:55:29,030 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231113fd399c87ccec4ba79e9bbb21a5972397 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231113fd399c87ccec4ba79e9bbb21a5972397 2023-11-13 04:55:29,032 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311139a76e17fd3a24bac8ccaf5a2daecebe1 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202311139a76e17fd3a24bac8ccaf5a2daecebe1 2023-11-13 04:55:29,035 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/.tmp/family2/906a994c989d4472b3f52483cb166dc1 2023-11-13 04:55:29,037 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/.tmp/family2/85472854195a4b80947a16a08878010b 2023-11-13 04:55:29,040 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/.tmp/family1/d893498a26aa4ec994b186037f8d8c00 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family1/d893498a26aa4ec994b186037f8d8c00 2023-11-13 04:55:29,041 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/.tmp/family1/30450d58c37146cfa37a0d92be436333 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family1/30450d58c37146cfa37a0d92be436333 2023-11-13 04:55:29,044 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family1/d893498a26aa4ec994b186037f8d8c00, entries=4, sequenceid=5, filesize=5.4 K 2023-11-13 04:55:29,044 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family1/30450d58c37146cfa37a0d92be436333, entries=4, sequenceid=5, filesize=5.4 K 2023-11-13 04:55:29,044 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/.tmp/family2/906a994c989d4472b3f52483cb166dc1 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family2/906a994c989d4472b3f52483cb166dc1 2023-11-13 04:55:29,045 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/.tmp/family2/85472854195a4b80947a16a08878010b as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family2/85472854195a4b80947a16a08878010b 2023-11-13 04:55:29,048 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family2/906a994c989d4472b3f52483cb166dc1, entries=2, sequenceid=5, filesize=5.1 K 2023-11-13 04:55:29,048 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family2/85472854195a4b80947a16a08878010b, entries=2, sequenceid=5, filesize=5.1 K 2023-11-13 04:55:29,048 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for beccf4b9bb7f1b9d4214b816ec12c591 in 1266ms, sequenceid=5, compaction requested=false 2023-11-13 04:55:29,049 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for beccf4b9bb7f1b9d4214b816ec12c591: 2023-11-13 04:55:29,049 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1699851325657.beccf4b9bb7f1b9d4214b816ec12c591. 2023-11-13 04:55:29,049 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-13 04:55:29,050 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 93b1e59720a53a032a804bf4ec0ce192 in 1268ms, sequenceid=5, compaction requested=false 2023-11-13 04:55:29,050 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 93b1e59720a53a032a804bf4ec0ce192: 2023-11-13 04:55:29,050 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1699851325657.93b1e59720a53a032a804bf4ec0ce192. 2023-11-13 04:55:29,050 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-13 04:55:29,432 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/.tmp/family2/de7cfe857dca4a20a60c047eaa9fabcb 2023-11-13 04:55:29,437 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/.tmp/family1/35a39da917fb42e892f42cc0b0a8caa2 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family1/35a39da917fb42e892f42cc0b0a8caa2 2023-11-13 04:55:29,440 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family1/35a39da917fb42e892f42cc0b0a8caa2, entries=4, sequenceid=5, filesize=5.4 K 2023-11-13 04:55:29,441 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/.tmp/family2/de7cfe857dca4a20a60c047eaa9fabcb as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family2/de7cfe857dca4a20a60c047eaa9fabcb 2023-11-13 04:55:29,444 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family2/de7cfe857dca4a20a60c047eaa9fabcb, entries=2, sequenceid=5, filesize=5.1 K 2023-11-13 04:55:29,445 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 69269bc0d44ad4030e108151ca591d2f in 1663ms, sequenceid=5, compaction requested=false 2023-11-13 04:55:29,445 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 69269bc0d44ad4030e108151ca591d2f: 2023-11-13 04:55:29,445 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1699851325657.69269bc0d44ad4030e108151ca591d2f. 2023-11-13 04:55:29,445 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-13 04:55:29,445 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-13 04:55:29,445 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:29,445 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-13 04:55:29,445 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-13 04:55:29,447 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:29,447 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-13 04:55:29,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:29,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:29,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:29,447 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-13 04:55:29,448 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:55:29,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:29,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:29,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-13 04:55:29,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:29,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:29,449 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-13 04:55:29,449 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2bd4a857[Count = 0] remaining members to acquire global barrier 2023-11-13 04:55:29,449 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-13 04:55:29,449 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-13 04:55:29,451 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-13 04:55:29,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-13 04:55:29,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-13 04:55:29,451 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-13 04:55:29,451 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-13 04:55:29,451 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:55:29,451 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:29,451 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:55:29,453 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-13 04:55:29,453 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:29,453 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:55:29,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:29,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:29,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:29,453 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-13 04:55:29,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:29,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:29,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-13 04:55:29,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:29,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:29,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-13 04:55:29,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:29,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:55:29,456 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-13 04:55:29,456 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-13 04:55:29,456 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:55:29,456 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:55:29,456 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-13 04:55:29,456 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:55:29,458 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-13 04:55:29,458 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-13 04:55:29,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-13 04:55:29,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:29,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:29,458 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-13 04:55:29,458 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:55:29,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-13 04:55:29,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:29,458 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:29,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-13 04:55:29,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:55:29,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:55:29,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:29,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-13 04:55:29,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-13 04:55:29,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:29,460 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:29,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:29,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-13 04:55:29,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:29,463 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:29,463 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-13 04:55:29,463 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:55:29,463 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:55:29,463 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-13 04:55:29,463 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:55:29,463 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:29,463 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-13 04:55:29,463 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:55:29,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:55:29,463 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-13 04:55:29,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:55:29,463 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-13 04:55:29,463 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-13 04:55:29,463 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-13 04:55:29,464 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:55:29,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:55:29,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:55:29,564 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:55:29,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:55:29,566 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1699851325657.beccf4b9bb7f1b9d4214b816ec12c591. with WAL disabled. Data may be lost in the event of a crash. 2023-11-13 04:55:29,566 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1699851325657.69269bc0d44ad4030e108151ca591d2f. with WAL disabled. Data may be lost in the event of a crash. 2023-11-13 04:55:29,566 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1699851325657.93b1e59720a53a032a804bf4ec0ce192. with WAL disabled. Data may be lost in the event of a crash. 2023-11-13 04:55:29,568 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:55:29,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-13 04:55:29,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-13 04:55:29,570 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-13 04:55:29,570 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:55:29,570 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-13 04:55:29,570 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-13 04:55:29,571 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-13 04:55:29,571 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-13 04:55:29,572 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:29,572 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:55:29,573 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:55:29,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:55:29,573 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:29,573 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:55:29,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-13 04:55:29,573 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-13 04:55:29,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:55:29,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-13 04:55:29,574 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-13 04:55:29,574 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-13 04:55:29,574 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-13 04:55:29,574 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-13 04:55:29,574 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:55:29,574 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-13 04:55:29,574 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1699851325657.beccf4b9bb7f1b9d4214b816ec12c591. 2023-11-13 04:55:29,574 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1699851325657.beccf4b9bb7f1b9d4214b816ec12c591. started... 2023-11-13 04:55:29,574 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1699851325657.69269bc0d44ad4030e108151ca591d2f. 2023-11-13 04:55:29,574 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-13 04:55:29,574 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1699851325657.93b1e59720a53a032a804bf4ec0ce192. 2023-11-13 04:55:29,574 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing beccf4b9bb7f1b9d4214b816ec12c591 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-13 04:55:29,574 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:55:29,574 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1699851325657.69269bc0d44ad4030e108151ca591d2f. started... 2023-11-13 04:55:29,574 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1699851325657.93b1e59720a53a032a804bf4ec0ce192. started... 2023-11-13 04:55:29,575 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 69269bc0d44ad4030e108151ca591d2f 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-13 04:55:29,575 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 93b1e59720a53a032a804bf4ec0ce192 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-13 04:55:29,991 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231113505ad3eb96db47ae8616417b394b405c to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231113505ad3eb96db47ae8616417b394b405c 2023-11-13 04:55:29,991 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311131f2aa3ebfa9b411cb8790a8009443aa0 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202311131f2aa3ebfa9b411cb8790a8009443aa0 2023-11-13 04:55:29,991 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231113ee2c85a89de84a8e8f84b2bb847ce252 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231113ee2c85a89de84a8e8f84b2bb847ce252 2023-11-13 04:55:30,402 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/.tmp/family1/829a98de4acc40d4a6c35adacf799f60 2023-11-13 04:55:30,402 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/.tmp/family1/8b1521a886b642d4825b601b79e90f9b 2023-11-13 04:55:30,403 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/.tmp/family1/298431f8164a412bab53548819f50717 2023-11-13 04:55:30,826 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111370b7a52e89294e679f2455cd6ff85903 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e2023111370b7a52e89294e679f2455cd6ff85903 2023-11-13 04:55:30,826 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231113838e7bfe56a1477ca0bd00426cc4be71 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231113838e7bfe56a1477ca0bd00426cc4be71 2023-11-13 04:55:30,830 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311137a4ce6b9fec6458892150f56dca4feb4 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202311137a4ce6b9fec6458892150f56dca4feb4 2023-11-13 04:55:31,231 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/.tmp/family2/ae81a7a535f743a190017e94a3c2891c 2023-11-13 04:55:31,232 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/.tmp/family2/4ace6dc8ba4c4a39b3941818923fc2a3 2023-11-13 04:55:31,234 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/.tmp/family2/82c149ef05af4d1f9748cde739995afe 2023-11-13 04:55:31,236 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/.tmp/family1/8b1521a886b642d4825b601b79e90f9b as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family1/8b1521a886b642d4825b601b79e90f9b 2023-11-13 04:55:31,236 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/.tmp/family1/298431f8164a412bab53548819f50717 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family1/298431f8164a412bab53548819f50717 2023-11-13 04:55:31,240 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/.tmp/family1/829a98de4acc40d4a6c35adacf799f60 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family1/829a98de4acc40d4a6c35adacf799f60 2023-11-13 04:55:31,241 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family1/8b1521a886b642d4825b601b79e90f9b, entries=4, sequenceid=9, filesize=5.4 K 2023-11-13 04:55:31,241 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/.tmp/family2/4ace6dc8ba4c4a39b3941818923fc2a3 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family2/4ace6dc8ba4c4a39b3941818923fc2a3 2023-11-13 04:55:31,242 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family1/298431f8164a412bab53548819f50717, entries=4, sequenceid=9, filesize=5.4 K 2023-11-13 04:55:31,242 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/.tmp/family2/ae81a7a535f743a190017e94a3c2891c as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family2/ae81a7a535f743a190017e94a3c2891c 2023-11-13 04:55:31,244 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family1/829a98de4acc40d4a6c35adacf799f60, entries=4, sequenceid=9, filesize=5.4 K 2023-11-13 04:55:31,245 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/.tmp/family2/82c149ef05af4d1f9748cde739995afe as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family2/82c149ef05af4d1f9748cde739995afe 2023-11-13 04:55:31,245 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family2/4ace6dc8ba4c4a39b3941818923fc2a3, entries=2, sequenceid=9, filesize=5.1 K 2023-11-13 04:55:31,246 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 93b1e59720a53a032a804bf4ec0ce192 in 1671ms, sequenceid=9, compaction requested=false 2023-11-13 04:55:31,246 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 93b1e59720a53a032a804bf4ec0ce192: 2023-11-13 04:55:31,246 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1699851325657.93b1e59720a53a032a804bf4ec0ce192. 2023-11-13 04:55:31,246 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-13 04:55:31,246 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family2/ae81a7a535f743a190017e94a3c2891c, entries=2, sequenceid=9, filesize=5.1 K 2023-11-13 04:55:31,247 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for beccf4b9bb7f1b9d4214b816ec12c591 in 1673ms, sequenceid=9, compaction requested=false 2023-11-13 04:55:31,247 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for beccf4b9bb7f1b9d4214b816ec12c591: 2023-11-13 04:55:31,247 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1699851325657.beccf4b9bb7f1b9d4214b816ec12c591. 2023-11-13 04:55:31,247 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-13 04:55:31,248 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family2/82c149ef05af4d1f9748cde739995afe, entries=2, sequenceid=9, filesize=5.1 K 2023-11-13 04:55:31,249 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 69269bc0d44ad4030e108151ca591d2f in 1674ms, sequenceid=9, compaction requested=false 2023-11-13 04:55:31,249 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 69269bc0d44ad4030e108151ca591d2f: 2023-11-13 04:55:31,249 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1699851325657.69269bc0d44ad4030e108151ca591d2f. 2023-11-13 04:55:31,249 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-13 04:55:31,249 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-13 04:55:31,249 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:31,249 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-13 04:55:31,250 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-13 04:55:31,251 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:31,251 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-13 04:55:31,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:31,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:31,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:31,252 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-13 04:55:31,252 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:55:31,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:31,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:31,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-13 04:55:31,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:31,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:31,253 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-13 04:55:31,253 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@108c4c67[Count = 0] remaining members to acquire global barrier 2023-11-13 04:55:31,253 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-13 04:55:31,254 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-13 04:55:31,255 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-13 04:55:31,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-13 04:55:31,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-13 04:55:31,255 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-13 04:55:31,255 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-13 04:55:31,255 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:55:31,255 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:31,255 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:55:31,256 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:31,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:31,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:31,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:31,257 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-13 04:55:31,257 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:55:31,257 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-13 04:55:31,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:31,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:31,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-13 04:55:31,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:31,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:31,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-13 04:55:31,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:31,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:55:31,259 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-13 04:55:31,259 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-13 04:55:31,259 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:55:31,259 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:55:31,259 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-13 04:55:31,259 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:55:31,262 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-13 04:55:31,262 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-13 04:55:31,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-13 04:55:31,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:31,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:31,262 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:55:31,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-13 04:55:31,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-13 04:55:31,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:31,262 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:31,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:55:31,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:55:31,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-13 04:55:31,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-13 04:55:31,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:31,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-13 04:55:31,264 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:31,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:31,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:31,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-13 04:55:31,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:31,266 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:31,266 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-13 04:55:31,266 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-13 04:55:31,266 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:31,266 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:55:31,266 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:55:31,266 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-13 04:55:31,266 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-13 04:55:31,266 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:55:31,266 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:55:31,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:55:31,266 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-11-13 04:55:31,267 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-13 04:55:31,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:55:31,267 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:55:31,267 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-13 04:55:31,267 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-13 04:55:31,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:55:31,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:55:31,367 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:55:31,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:55:31,369 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1699851325657.beccf4b9bb7f1b9d4214b816ec12c591. with WAL disabled. Data may be lost in the event of a crash. 2023-11-13 04:55:31,369 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1699851325657.69269bc0d44ad4030e108151ca591d2f. with WAL disabled. Data may be lost in the event of a crash. 2023-11-13 04:55:31,369 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1699851325657.93b1e59720a53a032a804bf4ec0ce192. with WAL disabled. Data may be lost in the event of a crash. 2023-11-13 04:55:31,371 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:55:31,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-13 04:55:31,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-13 04:55:31,373 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-13 04:55:31,373 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:55:31,373 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-13 04:55:31,373 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-13 04:55:31,374 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-13 04:55:31,374 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-13 04:55:31,375 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:31,375 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:55:31,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:55:31,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:55:31,375 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:31,376 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:55:31,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-13 04:55:31,376 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-13 04:55:31,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:55:31,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-13 04:55:31,376 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-13 04:55:31,377 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-13 04:55:31,377 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-13 04:55:31,377 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-13 04:55:31,377 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:55:31,377 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-13 04:55:31,377 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1699851325657.beccf4b9bb7f1b9d4214b816ec12c591. 2023-11-13 04:55:31,377 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1699851325657.beccf4b9bb7f1b9d4214b816ec12c591. started... 2023-11-13 04:55:31,377 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1699851325657.69269bc0d44ad4030e108151ca591d2f. 2023-11-13 04:55:31,377 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-13 04:55:31,377 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:55:31,377 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing beccf4b9bb7f1b9d4214b816ec12c591 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-13 04:55:31,377 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1699851325657.69269bc0d44ad4030e108151ca591d2f. started... 2023-11-13 04:55:31,377 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1699851325657.93b1e59720a53a032a804bf4ec0ce192. 2023-11-13 04:55:31,377 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1699851325657.93b1e59720a53a032a804bf4ec0ce192. started... 2023-11-13 04:55:31,377 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 69269bc0d44ad4030e108151ca591d2f 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-13 04:55:31,377 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 93b1e59720a53a032a804bf4ec0ce192 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-13 04:55:31,794 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023111362f12134c9a444f5a35fc06877daffd5 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023111362f12134c9a444f5a35fc06877daffd5 2023-11-13 04:55:31,794 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111381d86d7b44954354b2c63ee9add59c69 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023111381d86d7b44954354b2c63ee9add59c69 2023-11-13 04:55:31,798 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231113f7027389b2dd40b785be649f7b2004fb to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231113f7027389b2dd40b785be649f7b2004fb 2023-11-13 04:55:31,801 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/.tmp/family1/0bc4faf6b3114d09be0be7e43bd7e3cf 2023-11-13 04:55:31,825 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311133536a6ba08744655b02ebcea4a9d6a35 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202311133536a6ba08744655b02ebcea4a9d6a35 2023-11-13 04:55:31,830 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/.tmp/family2/304d12a2534d4b9da850e95b9306c0ba 2023-11-13 04:55:31,834 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/.tmp/family1/0bc4faf6b3114d09be0be7e43bd7e3cf as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family1/0bc4faf6b3114d09be0be7e43bd7e3cf 2023-11-13 04:55:31,838 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family1/0bc4faf6b3114d09be0be7e43bd7e3cf, entries=4, sequenceid=13, filesize=5.4 K 2023-11-13 04:55:31,838 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/.tmp/family2/304d12a2534d4b9da850e95b9306c0ba as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family2/304d12a2534d4b9da850e95b9306c0ba 2023-11-13 04:55:31,842 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family2/304d12a2534d4b9da850e95b9306c0ba, entries=2, sequenceid=13, filesize=5.1 K 2023-11-13 04:55:31,843 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 69269bc0d44ad4030e108151ca591d2f in 466ms, sequenceid=13, compaction requested=true 2023-11-13 04:55:31,843 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 69269bc0d44ad4030e108151ca591d2f: 2023-11-13 04:55:31,843 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1699851325657.69269bc0d44ad4030e108151ca591d2f. 2023-11-13 04:55:31,843 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-13 04:55:32,204 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/.tmp/family1/a70191158cbb42208b0d6df283eb069a 2023-11-13 04:55:32,212 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/.tmp/family1/b05ccc07ba13409f85d84244475cad8f 2023-11-13 04:55:32,306 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-13 04:55:32,325 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-13 04:55:32,325 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2941db19 to 127.0.0.1:51072 2023-11-13 04:55:32,325 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-13 04:55:32,326 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-13 04:55:32,326 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3686646a to 127.0.0.1:51072 2023-11-13 04:55:32,326 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-13 04:55:32,326 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-13 04:55:32,327 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3d642271 to 127.0.0.1:51072 2023-11-13 04:55:32,327 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-13 04:55:32,619 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311136293f4cf2d0749f385182fbdb6d33006 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202311136293f4cf2d0749f385182fbdb6d33006 2023-11-13 04:55:32,628 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111326513eb6572f43b3826f27189857a843 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e2023111326513eb6572f43b3826f27189857a843 2023-11-13 04:55:33,024 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/.tmp/family2/47ca8fd753be4f89a5f65c47983f47de 2023-11-13 04:55:33,028 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/.tmp/family1/a70191158cbb42208b0d6df283eb069a as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family1/a70191158cbb42208b0d6df283eb069a 2023-11-13 04:55:33,031 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family1/a70191158cbb42208b0d6df283eb069a, entries=4, sequenceid=13, filesize=5.4 K 2023-11-13 04:55:33,032 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/.tmp/family2/47ca8fd753be4f89a5f65c47983f47de as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family2/47ca8fd753be4f89a5f65c47983f47de 2023-11-13 04:55:33,032 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/.tmp/family2/aeaac985cde841d3acbcca3d510f09e6 2023-11-13 04:55:33,035 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family2/47ca8fd753be4f89a5f65c47983f47de, entries=2, sequenceid=13, filesize=5.1 K 2023-11-13 04:55:33,036 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 93b1e59720a53a032a804bf4ec0ce192 in 1659ms, sequenceid=13, compaction requested=true 2023-11-13 04:55:33,036 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 93b1e59720a53a032a804bf4ec0ce192: 2023-11-13 04:55:33,036 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1699851325657.93b1e59720a53a032a804bf4ec0ce192. 2023-11-13 04:55:33,036 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-13 04:55:33,036 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/.tmp/family1/b05ccc07ba13409f85d84244475cad8f as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family1/b05ccc07ba13409f85d84244475cad8f 2023-11-13 04:55:33,040 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family1/b05ccc07ba13409f85d84244475cad8f, entries=4, sequenceid=13, filesize=5.4 K 2023-11-13 04:55:33,040 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/.tmp/family2/aeaac985cde841d3acbcca3d510f09e6 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family2/aeaac985cde841d3acbcca3d510f09e6 2023-11-13 04:55:33,044 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family2/aeaac985cde841d3acbcca3d510f09e6, entries=2, sequenceid=13, filesize=5.1 K 2023-11-13 04:55:33,044 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for beccf4b9bb7f1b9d4214b816ec12c591 in 1667ms, sequenceid=13, compaction requested=true 2023-11-13 04:55:33,045 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for beccf4b9bb7f1b9d4214b816ec12c591: 2023-11-13 04:55:33,045 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1699851325657.beccf4b9bb7f1b9d4214b816ec12c591. 2023-11-13 04:55:33,045 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-13 04:55:33,045 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-13 04:55:33,045 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:33,045 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-13 04:55:33,045 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-13 04:55:33,047 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-13 04:55:33,047 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:33,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:33,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:33,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:33,047 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-13 04:55:33,047 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:55:33,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:33,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:33,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-13 04:55:33,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:33,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:33,049 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-13 04:55:33,049 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@338c2598[Count = 0] remaining members to acquire global barrier 2023-11-13 04:55:33,049 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-13 04:55:33,049 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-13 04:55:33,050 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-13 04:55:33,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-13 04:55:33,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-13 04:55:33,051 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-13 04:55:33,051 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-13 04:55:33,051 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:55:33,051 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:33,051 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:55:33,052 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-13 04:55:33,052 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:33,053 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:55:33,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:33,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:33,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:33,053 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-13 04:55:33,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:33,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:33,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-13 04:55:33,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:33,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:33,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-13 04:55:33,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:33,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:55:33,055 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-13 04:55:33,055 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-13 04:55:33,055 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:55:33,055 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:55:33,055 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-13 04:55:33,055 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:55:33,060 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-13 04:55:33,060 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-13 04:55:33,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-13 04:55:33,060 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:55:33,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-13 04:55:33,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-13 04:55:33,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:33,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:33,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:55:33,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:55:33,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:33,061 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:33,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-13 04:55:33,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-13 04:55:33,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:33,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-13 04:55:33,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:33,062 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:33,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:33,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-13 04:55:33,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:33,065 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:33,065 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-13 04:55:33,065 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-13 04:55:33,065 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:33,065 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-13 04:55:33,065 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-13 04:55:33,066 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-13 04:55:33,066 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:55:33,066 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:55:33,066 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-13 04:55:33,066 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:55:33,066 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:55:33,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:55:33,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:55:33,066 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-13 04:55:33,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:55:33,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:55:33,066 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:55:33,166 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:55:33,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:55:33,168 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1699851325657.beccf4b9bb7f1b9d4214b816ec12c591. with WAL disabled. Data may be lost in the event of a crash. 2023-11-13 04:55:33,168 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1699851325657.69269bc0d44ad4030e108151ca591d2f. with WAL disabled. Data may be lost in the event of a crash. 2023-11-13 04:55:33,168 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1699851325657.93b1e59720a53a032a804bf4ec0ce192. with WAL disabled. Data may be lost in the event of a crash. 2023-11-13 04:55:33,170 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:55:33,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-13 04:55:33,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-13 04:55:33,172 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-13 04:55:33,172 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:55:33,172 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-13 04:55:33,172 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-13 04:55:33,172 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-13 04:55:33,173 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-13 04:55:33,174 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:33,174 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:55:33,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:55:33,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:55:33,174 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:33,174 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:55:33,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-13 04:55:33,175 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-13 04:55:33,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:55:33,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-13 04:55:33,175 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-13 04:55:33,175 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-13 04:55:33,175 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-13 04:55:33,175 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-13 04:55:33,176 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:55:33,176 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-13 04:55:33,176 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1699851325657.beccf4b9bb7f1b9d4214b816ec12c591. 2023-11-13 04:55:33,176 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1699851325657.beccf4b9bb7f1b9d4214b816ec12c591. started... 2023-11-13 04:55:33,176 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1699851325657.69269bc0d44ad4030e108151ca591d2f. 2023-11-13 04:55:33,176 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1699851325657.69269bc0d44ad4030e108151ca591d2f. started... 2023-11-13 04:55:33,176 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing beccf4b9bb7f1b9d4214b816ec12c591 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-13 04:55:33,176 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 69269bc0d44ad4030e108151ca591d2f 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-13 04:55:33,176 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-13 04:55:33,176 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:55:33,176 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1699851325657.93b1e59720a53a032a804bf4ec0ce192. 2023-11-13 04:55:33,176 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1699851325657.93b1e59720a53a032a804bf4ec0ce192. started... 2023-11-13 04:55:33,177 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 93b1e59720a53a032a804bf4ec0ce192 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-13 04:55:33,190 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311134be126c603ea43e6a01a15418fd984c5 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202311134be126c603ea43e6a01a15418fd984c5 2023-11-13 04:55:33,194 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/.tmp/family1/50a18b0ebcc541688502b4c6e848b455 2023-11-13 04:55:33,209 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231113aa8424084bfc4f6483a1312db388eb17 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231113aa8424084bfc4f6483a1312db388eb17 2023-11-13 04:55:33,213 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/.tmp/family2/4772b00f12d742a8b6577705535f178b 2023-11-13 04:55:33,217 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/.tmp/family1/50a18b0ebcc541688502b4c6e848b455 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family1/50a18b0ebcc541688502b4c6e848b455 2023-11-13 04:55:33,220 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family1/50a18b0ebcc541688502b4c6e848b455, entries=4, sequenceid=17, filesize=5.4 K 2023-11-13 04:55:33,221 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/.tmp/family2/4772b00f12d742a8b6577705535f178b as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family2/4772b00f12d742a8b6577705535f178b 2023-11-13 04:55:33,224 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family2/4772b00f12d742a8b6577705535f178b, entries=2, sequenceid=17, filesize=5.1 K 2023-11-13 04:55:33,225 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 69269bc0d44ad4030e108151ca591d2f in 49ms, sequenceid=17, compaction requested=true 2023-11-13 04:55:33,225 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 69269bc0d44ad4030e108151ca591d2f: 2023-11-13 04:55:33,225 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1699851325657.69269bc0d44ad4030e108151ca591d2f. 2023-11-13 04:55:33,225 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-13 04:55:33,589 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231113b7e57e5f0aef4886bc3f801827036111 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231113b7e57e5f0aef4886bc3f801827036111 2023-11-13 04:55:33,591 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231113a67bc8badaeb4327bac207d2027b041d to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231113a67bc8badaeb4327bac207d2027b041d 2023-11-13 04:55:33,593 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/.tmp/family1/9515838340cb4942ba460c9c82198125 2023-11-13 04:55:33,607 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311133d087f60fbd34ec582140c685fa352e8 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202311133d087f60fbd34ec582140c685fa352e8 2023-11-13 04:55:33,611 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/.tmp/family2/f457506db05e436a8a1d5787572e28be 2023-11-13 04:55:33,614 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/.tmp/family1/9515838340cb4942ba460c9c82198125 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family1/9515838340cb4942ba460c9c82198125 2023-11-13 04:55:33,617 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family1/9515838340cb4942ba460c9c82198125, entries=4, sequenceid=17, filesize=5.4 K 2023-11-13 04:55:33,618 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/.tmp/family2/f457506db05e436a8a1d5787572e28be as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family2/f457506db05e436a8a1d5787572e28be 2023-11-13 04:55:33,621 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family2/f457506db05e436a8a1d5787572e28be, entries=2, sequenceid=17, filesize=5.1 K 2023-11-13 04:55:33,622 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for beccf4b9bb7f1b9d4214b816ec12c591 in 445ms, sequenceid=17, compaction requested=true 2023-11-13 04:55:33,622 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for beccf4b9bb7f1b9d4214b816ec12c591: 2023-11-13 04:55:33,622 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1699851325657.beccf4b9bb7f1b9d4214b816ec12c591. 2023-11-13 04:55:33,622 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-13 04:55:33,996 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/.tmp/family1/93259733ec5a422780fb9c8505446f27 2023-11-13 04:55:34,410 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311132a4766de63304a88bb5815e933bf12a8 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202311132a4766de63304a88bb5815e933bf12a8 2023-11-13 04:55:34,815 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/.tmp/family2/ba8d82d3b67a468ca6212b44c87aa36b 2023-11-13 04:55:34,819 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/.tmp/family1/93259733ec5a422780fb9c8505446f27 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family1/93259733ec5a422780fb9c8505446f27 2023-11-13 04:55:34,823 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family1/93259733ec5a422780fb9c8505446f27, entries=4, sequenceid=17, filesize=5.4 K 2023-11-13 04:55:34,823 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/.tmp/family2/ba8d82d3b67a468ca6212b44c87aa36b as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family2/ba8d82d3b67a468ca6212b44c87aa36b 2023-11-13 04:55:34,827 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family2/ba8d82d3b67a468ca6212b44c87aa36b, entries=2, sequenceid=17, filesize=5.1 K 2023-11-13 04:55:34,828 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 93b1e59720a53a032a804bf4ec0ce192 in 1651ms, sequenceid=17, compaction requested=true 2023-11-13 04:55:34,828 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 93b1e59720a53a032a804bf4ec0ce192: 2023-11-13 04:55:34,828 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1699851325657.93b1e59720a53a032a804bf4ec0ce192. 2023-11-13 04:55:34,828 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-13 04:55:34,828 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-13 04:55:34,828 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:34,828 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-13 04:55:34,828 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-13 04:55:34,830 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:34,830 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-13 04:55:34,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:34,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:34,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:34,830 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-13 04:55:34,830 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:55:34,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:34,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:34,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-13 04:55:34,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:34,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:34,831 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-13 04:55:34,831 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@40b4e49c[Count = 0] remaining members to acquire global barrier 2023-11-13 04:55:34,831 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-13 04:55:34,832 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-13 04:55:34,837 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-13 04:55:34,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-13 04:55:34,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-13 04:55:34,837 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-13 04:55:34,837 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-13 04:55:34,837 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:55:34,837 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:34,837 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:55:34,838 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:34,839 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-13 04:55:34,839 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:55:34,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:34,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:34,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:34,839 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-13 04:55:34,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:34,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:34,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-13 04:55:34,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:34,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:34,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-13 04:55:34,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:34,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:55:34,841 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-13 04:55:34,841 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-13 04:55:34,841 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:55:34,841 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:55:34,841 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-13 04:55:34,841 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:55:34,842 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-13 04:55:34,842 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-13 04:55:34,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-13 04:55:34,843 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:55:34,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:34,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:34,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-13 04:55:34,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-13 04:55:34,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:34,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:55:34,843 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:34,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:55:34,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-13 04:55:34,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-13 04:55:34,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:34,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-13 04:55:34,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:34,844 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:34,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:34,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-13 04:55:34,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:34,849 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:34,849 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-13 04:55:34,849 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:55:34,849 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-13 04:55:34,849 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:55:34,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:55:34,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:55:34,849 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:55:34,849 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-13 04:55:34,850 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:55:34,849 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:34,850 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-13 04:55:34,850 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-13 04:55:34,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:55:34,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:55:34,850 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-13 04:55:34,850 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:55:34,850 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-13 04:55:34,950 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:55:34,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:55:34,963 DEBUG [Listener at localhost/34517] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-13 04:55:34,974 DEBUG [Listener at localhost/34517] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-13 04:55:34,982 DEBUG [Listener at localhost/34517] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-13 04:55:34,983 DEBUG [Listener at localhost/34517] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-13 04:55:35,007 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:55:35,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-13 04:55:35,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-13 04:55:35,009 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-13 04:55:35,009 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:55:35,009 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-13 04:55:35,009 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-13 04:55:35,010 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-13 04:55:35,010 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-13 04:55:35,012 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:55:35,012 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:35,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:55:35,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:55:35,012 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:35,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-13 04:55:35,012 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:55:35,013 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-13 04:55:35,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:55:35,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-13 04:55:35,013 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-13 04:55:35,013 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-13 04:55:35,013 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-13 04:55:35,013 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-13 04:55:35,013 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:55:35,013 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-13 04:55:35,014 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1699851325657.beccf4b9bb7f1b9d4214b816ec12c591. 2023-11-13 04:55:35,014 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-13 04:55:35,014 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:55:35,014 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1699851325657.69269bc0d44ad4030e108151ca591d2f. 2023-11-13 04:55:35,014 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1699851325657.93b1e59720a53a032a804bf4ec0ce192. 2023-11-13 04:55:35,014 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1699851325657.93b1e59720a53a032a804bf4ec0ce192. started... 2023-11-13 04:55:35,014 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1699851325657.beccf4b9bb7f1b9d4214b816ec12c591. started... 2023-11-13 04:55:35,014 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1699851325657.69269bc0d44ad4030e108151ca591d2f. started... 2023-11-13 04:55:35,014 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 93b1e59720a53a032a804bf4ec0ce192 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-13 04:55:35,014 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing beccf4b9bb7f1b9d4214b816ec12c591 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-13 04:55:35,014 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 69269bc0d44ad4030e108151ca591d2f 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-13 04:55:35,428 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/.tmp/family1/6c3e4255704448a3ba11eaece6b83dbe 2023-11-13 04:55:35,428 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/.tmp/family1/3ad88e0eb8de47d59d9e6317fa37978d 2023-11-13 04:55:35,433 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6c3e4255704448a3ba11eaece6b83dbe 2023-11-13 04:55:35,433 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3ad88e0eb8de47d59d9e6317fa37978d 2023-11-13 04:55:35,828 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/.tmp/family1/950a7b9594a44a9c9f7cf0edfecc8aff 2023-11-13 04:55:35,831 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 950a7b9594a44a9c9f7cf0edfecc8aff 2023-11-13 04:55:35,851 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/.tmp/family2/4d95b125bf1c4d15bb5450ee1c58c50b 2023-11-13 04:55:35,854 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4d95b125bf1c4d15bb5450ee1c58c50b 2023-11-13 04:55:35,855 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/.tmp/family1/6c3e4255704448a3ba11eaece6b83dbe as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family1/6c3e4255704448a3ba11eaece6b83dbe 2023-11-13 04:55:35,859 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6c3e4255704448a3ba11eaece6b83dbe 2023-11-13 04:55:35,859 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family1/6c3e4255704448a3ba11eaece6b83dbe, entries=3, sequenceid=23, filesize=5.0 K 2023-11-13 04:55:35,859 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/.tmp/family2/4d95b125bf1c4d15bb5450ee1c58c50b as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family2/4d95b125bf1c4d15bb5450ee1c58c50b 2023-11-13 04:55:35,862 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4d95b125bf1c4d15bb5450ee1c58c50b 2023-11-13 04:55:35,863 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family2/4d95b125bf1c4d15bb5450ee1c58c50b, entries=1, sequenceid=23, filesize=5.0 K 2023-11-13 04:55:35,863 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 69269bc0d44ad4030e108151ca591d2f in 849ms, sequenceid=23, compaction requested=true 2023-11-13 04:55:35,863 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 69269bc0d44ad4030e108151ca591d2f: 2023-11-13 04:55:35,863 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1699851325657.69269bc0d44ad4030e108151ca591d2f. 2023-11-13 04:55:35,863 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-13 04:55:36,248 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/.tmp/family2/0109dc9c063a4c199028bd8dff2a8a5e 2023-11-13 04:55:36,251 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0109dc9c063a4c199028bd8dff2a8a5e 2023-11-13 04:55:36,252 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/.tmp/family1/3ad88e0eb8de47d59d9e6317fa37978d as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family1/3ad88e0eb8de47d59d9e6317fa37978d 2023-11-13 04:55:36,255 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3ad88e0eb8de47d59d9e6317fa37978d 2023-11-13 04:55:36,255 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family1/3ad88e0eb8de47d59d9e6317fa37978d, entries=3, sequenceid=23, filesize=5.0 K 2023-11-13 04:55:36,256 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/.tmp/family2/0109dc9c063a4c199028bd8dff2a8a5e as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family2/0109dc9c063a4c199028bd8dff2a8a5e 2023-11-13 04:55:36,259 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0109dc9c063a4c199028bd8dff2a8a5e 2023-11-13 04:55:36,259 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family2/0109dc9c063a4c199028bd8dff2a8a5e, entries=1, sequenceid=23, filesize=5.0 K 2023-11-13 04:55:36,260 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for beccf4b9bb7f1b9d4214b816ec12c591 in 1245ms, sequenceid=23, compaction requested=true 2023-11-13 04:55:36,260 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for beccf4b9bb7f1b9d4214b816ec12c591: 2023-11-13 04:55:36,260 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1699851325657.beccf4b9bb7f1b9d4214b816ec12c591. 2023-11-13 04:55:36,260 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-13 04:55:36,643 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/.tmp/family2/348a60664e20417baabfa70ccd7994de 2023-11-13 04:55:36,647 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 348a60664e20417baabfa70ccd7994de 2023-11-13 04:55:36,647 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/.tmp/family1/950a7b9594a44a9c9f7cf0edfecc8aff as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family1/950a7b9594a44a9c9f7cf0edfecc8aff 2023-11-13 04:55:36,650 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 950a7b9594a44a9c9f7cf0edfecc8aff 2023-11-13 04:55:36,650 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family1/950a7b9594a44a9c9f7cf0edfecc8aff, entries=3, sequenceid=23, filesize=5.0 K 2023-11-13 04:55:36,651 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/.tmp/family2/348a60664e20417baabfa70ccd7994de as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family2/348a60664e20417baabfa70ccd7994de 2023-11-13 04:55:36,654 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 348a60664e20417baabfa70ccd7994de 2023-11-13 04:55:36,654 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family2/348a60664e20417baabfa70ccd7994de, entries=1, sequenceid=23, filesize=5.0 K 2023-11-13 04:55:36,655 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 93b1e59720a53a032a804bf4ec0ce192 in 1641ms, sequenceid=23, compaction requested=true 2023-11-13 04:55:36,655 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 93b1e59720a53a032a804bf4ec0ce192: 2023-11-13 04:55:36,655 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1699851325657.93b1e59720a53a032a804bf4ec0ce192. 2023-11-13 04:55:36,655 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-13 04:55:36,655 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-13 04:55:36,655 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:36,655 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-13 04:55:36,655 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-13 04:55:36,657 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-13 04:55:36,657 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:36,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:36,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:36,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:36,657 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-13 04:55:36,657 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:55:36,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:36,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:36,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-13 04:55:36,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:36,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:36,659 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-13 04:55:36,659 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4eac6acd[Count = 0] remaining members to acquire global barrier 2023-11-13 04:55:36,659 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-13 04:55:36,659 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-13 04:55:36,660 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-13 04:55:36,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-13 04:55:36,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-13 04:55:36,660 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-13 04:55:36,660 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:36,660 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:55:36,660 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-13 04:55:36,660 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:55:36,662 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:36,662 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-13 04:55:36,662 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:55:36,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:36,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:36,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:36,662 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-13 04:55:36,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:36,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:36,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-13 04:55:36,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:36,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:36,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-13 04:55:36,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:36,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:55:36,664 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-13 04:55:36,664 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-13 04:55:36,664 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:55:36,664 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:55:36,664 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-13 04:55:36,664 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:55:36,667 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-13 04:55:36,667 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-13 04:55:36,667 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:55:36,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-13 04:55:36,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:36,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:36,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-13 04:55:36,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-13 04:55:36,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:55:36,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:36,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:55:36,668 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:36,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-13 04:55:36,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-13 04:55:36,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:36,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-13 04:55:36,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:36,669 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:36,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:36,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-13 04:55:36,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:36,672 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:36,672 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-13 04:55:36,672 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:55:36,672 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-13 04:55:36,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:55:36,672 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:36,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:55:36,672 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-13 04:55:36,672 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:55:36,672 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:55:36,672 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:55:36,672 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-13 04:55:36,672 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-13 04:55:36,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:55:36,672 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-13 04:55:36,672 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-13 04:55:36,672 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:55:36,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:55:36,772 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:55:36,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:55:36,773 DEBUG [Listener at localhost/34517] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-13 04:55:36,774 DEBUG [Listener at localhost/34517] regionserver.HStore(1912): beccf4b9bb7f1b9d4214b816ec12c591/family1 is initiating major compaction (all files) 2023-11-13 04:55:36,774 INFO [Listener at localhost/34517] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-13 04:55:36,774 INFO [Listener at localhost/34517] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-13 04:55:36,774 INFO [Listener at localhost/34517] regionserver.HRegion(2259): Starting compaction of beccf4b9bb7f1b9d4214b816ec12c591/family1 in ns:testMinorCompaction,,1699851325657.beccf4b9bb7f1b9d4214b816ec12c591. 2023-11-13 04:55:36,774 INFO [Listener at localhost/34517] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family1/d893498a26aa4ec994b186037f8d8c00, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family1/298431f8164a412bab53548819f50717, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family1/b05ccc07ba13409f85d84244475cad8f, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family1/9515838340cb4942ba460c9c82198125, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family1/3ad88e0eb8de47d59d9e6317fa37978d] into tmpdir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/.tmp, totalSize=26.6 K 2023-11-13 04:55:36,775 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting d893498a26aa4ec994b186037f8d8c00, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699851327771 2023-11-13 04:55:36,775 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 298431f8164a412bab53548819f50717, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699851329566 2023-11-13 04:55:36,775 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting b05ccc07ba13409f85d84244475cad8f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699851331369 2023-11-13 04:55:36,776 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 9515838340cb4942ba460c9c82198125, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699851333168 2023-11-13 04:55:36,776 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 3ad88e0eb8de47d59d9e6317fa37978d, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-13 04:55:36,785 INFO [Listener at localhost/34517] throttle.PressureAwareThroughputController(145): beccf4b9bb7f1b9d4214b816ec12c591#family1#compaction#149 average throughput is 0.55 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-13 04:55:37,193 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231113c2ff3ee681bd449e9a22ee27af8355ba_del 2023-11-13 04:55:37,193 INFO [Listener at localhost/34517] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231113c2ff3ee681bd449e9a22ee27af8355ba_del to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231113c2ff3ee681bd449e9a22ee27af8355ba_del 2023-11-13 04:55:38,006 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for eb9861996abb4ffabfc7770c71c55738 2023-11-13 04:55:38,007 DEBUG [Listener at localhost/34517] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/.tmp/family1/eb9861996abb4ffabfc7770c71c55738 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family1/eb9861996abb4ffabfc7770c71c55738 2023-11-13 04:55:38,010 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for eb9861996abb4ffabfc7770c71c55738 2023-11-13 04:55:38,011 INFO [Listener at localhost/34517] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in beccf4b9bb7f1b9d4214b816ec12c591/family1 of beccf4b9bb7f1b9d4214b816ec12c591 into eb9861996abb4ffabfc7770c71c55738(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-13 04:55:38,011 DEBUG [Listener at localhost/34517] regionserver.HRegion(2289): Compaction status journal for beccf4b9bb7f1b9d4214b816ec12c591: 2023-11-13 04:55:38,011 DEBUG [Listener at localhost/34517] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-13 04:55:38,011 DEBUG [Listener at localhost/34517] regionserver.HStore(1912): beccf4b9bb7f1b9d4214b816ec12c591/family2 is initiating major compaction (all files) 2023-11-13 04:55:38,011 INFO [Listener at localhost/34517] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-13 04:55:38,011 INFO [Listener at localhost/34517] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-13 04:55:38,012 INFO [Listener at localhost/34517] regionserver.HRegion(2259): Starting compaction of beccf4b9bb7f1b9d4214b816ec12c591/family2 in ns:testMinorCompaction,,1699851325657.beccf4b9bb7f1b9d4214b816ec12c591. 2023-11-13 04:55:38,012 INFO [Listener at localhost/34517] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family2/906a994c989d4472b3f52483cb166dc1, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family2/ae81a7a535f743a190017e94a3c2891c, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family2/aeaac985cde841d3acbcca3d510f09e6, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family2/f457506db05e436a8a1d5787572e28be, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family2/0109dc9c063a4c199028bd8dff2a8a5e] into tmpdir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/.tmp, totalSize=25.3 K 2023-11-13 04:55:38,012 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 906a994c989d4472b3f52483cb166dc1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699851327771 2023-11-13 04:55:38,013 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting ae81a7a535f743a190017e94a3c2891c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699851329566 2023-11-13 04:55:38,013 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting aeaac985cde841d3acbcca3d510f09e6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699851331369 2023-11-13 04:55:38,013 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting f457506db05e436a8a1d5787572e28be, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699851333168 2023-11-13 04:55:38,014 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 0109dc9c063a4c199028bd8dff2a8a5e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-13 04:55:38,014 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family1/d893498a26aa4ec994b186037f8d8c00, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family1/298431f8164a412bab53548819f50717, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family1/b05ccc07ba13409f85d84244475cad8f, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family1/9515838340cb4942ba460c9c82198125, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family1/3ad88e0eb8de47d59d9e6317fa37978d] to archive 2023-11-13 04:55:38,015 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:55:38,017 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family1/d893498a26aa4ec994b186037f8d8c00 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family1/d893498a26aa4ec994b186037f8d8c00 2023-11-13 04:55:38,018 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family1/298431f8164a412bab53548819f50717 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family1/298431f8164a412bab53548819f50717 2023-11-13 04:55:38,020 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family1/b05ccc07ba13409f85d84244475cad8f to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family1/b05ccc07ba13409f85d84244475cad8f 2023-11-13 04:55:38,021 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family1/9515838340cb4942ba460c9c82198125 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family1/9515838340cb4942ba460c9c82198125 2023-11-13 04:55:38,023 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family1/3ad88e0eb8de47d59d9e6317fa37978d to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family1/3ad88e0eb8de47d59d9e6317fa37978d 2023-11-13 04:55:38,024 INFO [Listener at localhost/34517] throttle.PressureAwareThroughputController(145): beccf4b9bb7f1b9d4214b816ec12c591#family2#compaction#150 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-13 04:55:38,435 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231113e24150325f6f49aaa0bc4d0ecc96fd4b_del 2023-11-13 04:55:38,435 INFO [Listener at localhost/34517] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231113e24150325f6f49aaa0bc4d0ecc96fd4b_del to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231113e24150325f6f49aaa0bc4d0ecc96fd4b_del 2023-11-13 04:55:39,249 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 41d9c73a34384a40a402530bb8582a8d 2023-11-13 04:55:39,250 DEBUG [Listener at localhost/34517] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/.tmp/family2/41d9c73a34384a40a402530bb8582a8d as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family2/41d9c73a34384a40a402530bb8582a8d 2023-11-13 04:55:39,253 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 41d9c73a34384a40a402530bb8582a8d 2023-11-13 04:55:39,254 INFO [Listener at localhost/34517] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in beccf4b9bb7f1b9d4214b816ec12c591/family2 of beccf4b9bb7f1b9d4214b816ec12c591 into 41d9c73a34384a40a402530bb8582a8d(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-13 04:55:39,254 DEBUG [Listener at localhost/34517] regionserver.HRegion(2289): Compaction status journal for beccf4b9bb7f1b9d4214b816ec12c591: 2023-11-13 04:55:39,254 DEBUG [Listener at localhost/34517] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-13 04:55:39,254 DEBUG [Listener at localhost/34517] regionserver.HStore(1912): 69269bc0d44ad4030e108151ca591d2f/family1 is initiating major compaction (all files) 2023-11-13 04:55:39,254 INFO [Listener at localhost/34517] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-13 04:55:39,255 INFO [Listener at localhost/34517] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-13 04:55:39,255 INFO [Listener at localhost/34517] regionserver.HRegion(2259): Starting compaction of 69269bc0d44ad4030e108151ca591d2f/family1 in ns:testMinorCompaction,1,1699851325657.69269bc0d44ad4030e108151ca591d2f. 2023-11-13 04:55:39,255 INFO [Listener at localhost/34517] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family1/35a39da917fb42e892f42cc0b0a8caa2, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family1/829a98de4acc40d4a6c35adacf799f60, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family1/0bc4faf6b3114d09be0be7e43bd7e3cf, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family1/50a18b0ebcc541688502b4c6e848b455, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family1/6c3e4255704448a3ba11eaece6b83dbe] into tmpdir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/.tmp, totalSize=26.6 K 2023-11-13 04:55:39,256 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 35a39da917fb42e892f42cc0b0a8caa2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699851327772 2023-11-13 04:55:39,256 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 829a98de4acc40d4a6c35adacf799f60, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699851329566 2023-11-13 04:55:39,256 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 0bc4faf6b3114d09be0be7e43bd7e3cf, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699851331369 2023-11-13 04:55:39,257 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 50a18b0ebcc541688502b4c6e848b455, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699851333168 2023-11-13 04:55:39,257 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 6c3e4255704448a3ba11eaece6b83dbe, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-13 04:55:39,264 INFO [Listener at localhost/34517] throttle.PressureAwareThroughputController(145): 69269bc0d44ad4030e108151ca591d2f#family1#compaction#151 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-13 04:55:39,314 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family2/906a994c989d4472b3f52483cb166dc1, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family2/ae81a7a535f743a190017e94a3c2891c, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family2/aeaac985cde841d3acbcca3d510f09e6, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family2/f457506db05e436a8a1d5787572e28be, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family2/0109dc9c063a4c199028bd8dff2a8a5e] to archive 2023-11-13 04:55:39,315 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:55:39,316 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family2/906a994c989d4472b3f52483cb166dc1 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family2/906a994c989d4472b3f52483cb166dc1 2023-11-13 04:55:39,317 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family2/ae81a7a535f743a190017e94a3c2891c to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family2/ae81a7a535f743a190017e94a3c2891c 2023-11-13 04:55:39,318 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family2/aeaac985cde841d3acbcca3d510f09e6 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family2/aeaac985cde841d3acbcca3d510f09e6 2023-11-13 04:55:39,319 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family2/f457506db05e436a8a1d5787572e28be to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family2/f457506db05e436a8a1d5787572e28be 2023-11-13 04:55:39,320 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family2/0109dc9c063a4c199028bd8dff2a8a5e to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family2/0109dc9c063a4c199028bd8dff2a8a5e 2023-11-13 04:55:39,672 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202311137c265726c33b4e7daa0836724c17c8eb_del 2023-11-13 04:55:39,672 INFO [Listener at localhost/34517] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311137c265726c33b4e7daa0836724c17c8eb_del to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202311137c265726c33b4e7daa0836724c17c8eb_del 2023-11-13 04:55:40,486 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8d8bb5c3447149378868eecb8f59fe4a 2023-11-13 04:55:40,487 DEBUG [Listener at localhost/34517] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/.tmp/family1/8d8bb5c3447149378868eecb8f59fe4a as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family1/8d8bb5c3447149378868eecb8f59fe4a 2023-11-13 04:55:40,491 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8d8bb5c3447149378868eecb8f59fe4a 2023-11-13 04:55:40,492 INFO [Listener at localhost/34517] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 69269bc0d44ad4030e108151ca591d2f/family1 of 69269bc0d44ad4030e108151ca591d2f into 8d8bb5c3447149378868eecb8f59fe4a(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-13 04:55:40,492 DEBUG [Listener at localhost/34517] regionserver.HRegion(2289): Compaction status journal for 69269bc0d44ad4030e108151ca591d2f: 2023-11-13 04:55:40,492 DEBUG [Listener at localhost/34517] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-13 04:55:40,492 DEBUG [Listener at localhost/34517] regionserver.HStore(1912): 69269bc0d44ad4030e108151ca591d2f/family2 is initiating major compaction (all files) 2023-11-13 04:55:40,493 INFO [Listener at localhost/34517] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-13 04:55:40,493 INFO [Listener at localhost/34517] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-13 04:55:40,493 INFO [Listener at localhost/34517] regionserver.HRegion(2259): Starting compaction of 69269bc0d44ad4030e108151ca591d2f/family2 in ns:testMinorCompaction,1,1699851325657.69269bc0d44ad4030e108151ca591d2f. 2023-11-13 04:55:40,493 INFO [Listener at localhost/34517] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family2/de7cfe857dca4a20a60c047eaa9fabcb, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family2/82c149ef05af4d1f9748cde739995afe, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family2/304d12a2534d4b9da850e95b9306c0ba, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family2/4772b00f12d742a8b6577705535f178b, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family2/4d95b125bf1c4d15bb5450ee1c58c50b] into tmpdir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/.tmp, totalSize=25.3 K 2023-11-13 04:55:40,494 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting de7cfe857dca4a20a60c047eaa9fabcb, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699851327772 2023-11-13 04:55:40,494 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 82c149ef05af4d1f9748cde739995afe, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699851329566 2023-11-13 04:55:40,494 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 304d12a2534d4b9da850e95b9306c0ba, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699851331369 2023-11-13 04:55:40,495 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 4772b00f12d742a8b6577705535f178b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699851333168 2023-11-13 04:55:40,495 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 4d95b125bf1c4d15bb5450ee1c58c50b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-13 04:55:40,505 INFO [Listener at localhost/34517] throttle.PressureAwareThroughputController(145): 69269bc0d44ad4030e108151ca591d2f#family2#compaction#152 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-13 04:55:40,514 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family1/35a39da917fb42e892f42cc0b0a8caa2, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family1/829a98de4acc40d4a6c35adacf799f60, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family1/0bc4faf6b3114d09be0be7e43bd7e3cf, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family1/50a18b0ebcc541688502b4c6e848b455, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family1/6c3e4255704448a3ba11eaece6b83dbe] to archive 2023-11-13 04:55:40,515 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:55:40,516 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family1/35a39da917fb42e892f42cc0b0a8caa2 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family1/35a39da917fb42e892f42cc0b0a8caa2 2023-11-13 04:55:40,517 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family1/829a98de4acc40d4a6c35adacf799f60 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family1/829a98de4acc40d4a6c35adacf799f60 2023-11-13 04:55:40,518 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family1/0bc4faf6b3114d09be0be7e43bd7e3cf to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family1/0bc4faf6b3114d09be0be7e43bd7e3cf 2023-11-13 04:55:40,520 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family1/50a18b0ebcc541688502b4c6e848b455 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family1/50a18b0ebcc541688502b4c6e848b455 2023-11-13 04:55:40,521 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family1/6c3e4255704448a3ba11eaece6b83dbe to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family1/6c3e4255704448a3ba11eaece6b83dbe 2023-11-13 04:55:40,917 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202311132c070920997b436585f7c28b79871e29_del 2023-11-13 04:55:40,917 INFO [Listener at localhost/34517] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311132c070920997b436585f7c28b79871e29_del to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202311132c070920997b436585f7c28b79871e29_del 2023-11-13 04:55:41,730 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 398e7c63c0484e6c87e52675ccdcb1fd 2023-11-13 04:55:41,731 DEBUG [Listener at localhost/34517] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/.tmp/family2/398e7c63c0484e6c87e52675ccdcb1fd as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family2/398e7c63c0484e6c87e52675ccdcb1fd 2023-11-13 04:55:41,734 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 398e7c63c0484e6c87e52675ccdcb1fd 2023-11-13 04:55:41,735 INFO [Listener at localhost/34517] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 69269bc0d44ad4030e108151ca591d2f/family2 of 69269bc0d44ad4030e108151ca591d2f into 398e7c63c0484e6c87e52675ccdcb1fd(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-13 04:55:41,735 DEBUG [Listener at localhost/34517] regionserver.HRegion(2289): Compaction status journal for 69269bc0d44ad4030e108151ca591d2f: 2023-11-13 04:55:41,735 DEBUG [Listener at localhost/34517] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-13 04:55:41,735 DEBUG [Listener at localhost/34517] regionserver.HStore(1912): 93b1e59720a53a032a804bf4ec0ce192/family1 is initiating major compaction (all files) 2023-11-13 04:55:41,735 INFO [Listener at localhost/34517] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-13 04:55:41,735 INFO [Listener at localhost/34517] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-13 04:55:41,736 INFO [Listener at localhost/34517] regionserver.HRegion(2259): Starting compaction of 93b1e59720a53a032a804bf4ec0ce192/family1 in ns:testMinorCompaction,2,1699851325657.93b1e59720a53a032a804bf4ec0ce192. 2023-11-13 04:55:41,736 INFO [Listener at localhost/34517] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family1/30450d58c37146cfa37a0d92be436333, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family1/8b1521a886b642d4825b601b79e90f9b, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family1/a70191158cbb42208b0d6df283eb069a, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family1/93259733ec5a422780fb9c8505446f27, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family1/950a7b9594a44a9c9f7cf0edfecc8aff] into tmpdir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/.tmp, totalSize=26.6 K 2023-11-13 04:55:41,736 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 30450d58c37146cfa37a0d92be436333, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699851327772 2023-11-13 04:55:41,736 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 8b1521a886b642d4825b601b79e90f9b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699851329566 2023-11-13 04:55:41,737 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting a70191158cbb42208b0d6df283eb069a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699851331369 2023-11-13 04:55:41,737 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 93259733ec5a422780fb9c8505446f27, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699851333168 2023-11-13 04:55:41,737 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 950a7b9594a44a9c9f7cf0edfecc8aff, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-13 04:55:41,746 INFO [Listener at localhost/34517] throttle.PressureAwareThroughputController(145): 93b1e59720a53a032a804bf4ec0ce192#family1#compaction#153 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-13 04:55:41,814 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family2/de7cfe857dca4a20a60c047eaa9fabcb, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family2/82c149ef05af4d1f9748cde739995afe, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family2/304d12a2534d4b9da850e95b9306c0ba, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family2/4772b00f12d742a8b6577705535f178b, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family2/4d95b125bf1c4d15bb5450ee1c58c50b] to archive 2023-11-13 04:55:41,815 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:55:41,816 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family2/de7cfe857dca4a20a60c047eaa9fabcb to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family2/de7cfe857dca4a20a60c047eaa9fabcb 2023-11-13 04:55:41,818 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family2/82c149ef05af4d1f9748cde739995afe to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family2/82c149ef05af4d1f9748cde739995afe 2023-11-13 04:55:41,819 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family2/304d12a2534d4b9da850e95b9306c0ba to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family2/304d12a2534d4b9da850e95b9306c0ba 2023-11-13 04:55:41,820 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family2/4772b00f12d742a8b6577705535f178b to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family2/4772b00f12d742a8b6577705535f178b 2023-11-13 04:55:41,821 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family2/4d95b125bf1c4d15bb5450ee1c58c50b to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family2/4d95b125bf1c4d15bb5450ee1c58c50b 2023-11-13 04:55:42,154 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311139fa0e63224e74161844d4f21739c0efb_del 2023-11-13 04:55:42,154 INFO [Listener at localhost/34517] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311139fa0e63224e74161844d4f21739c0efb_del to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202311139fa0e63224e74161844d4f21739c0efb_del 2023-11-13 04:55:42,967 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9a0f0227798441dd91ef9179df6bb9a6 2023-11-13 04:55:42,967 DEBUG [Listener at localhost/34517] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/.tmp/family1/9a0f0227798441dd91ef9179df6bb9a6 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family1/9a0f0227798441dd91ef9179df6bb9a6 2023-11-13 04:55:42,970 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9a0f0227798441dd91ef9179df6bb9a6 2023-11-13 04:55:42,971 INFO [Listener at localhost/34517] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 93b1e59720a53a032a804bf4ec0ce192/family1 of 93b1e59720a53a032a804bf4ec0ce192 into 9a0f0227798441dd91ef9179df6bb9a6(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-13 04:55:42,971 DEBUG [Listener at localhost/34517] regionserver.HRegion(2289): Compaction status journal for 93b1e59720a53a032a804bf4ec0ce192: 2023-11-13 04:55:42,971 DEBUG [Listener at localhost/34517] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-13 04:55:42,972 DEBUG [Listener at localhost/34517] regionserver.HStore(1912): 93b1e59720a53a032a804bf4ec0ce192/family2 is initiating major compaction (all files) 2023-11-13 04:55:42,972 INFO [Listener at localhost/34517] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-13 04:55:42,972 INFO [Listener at localhost/34517] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-13 04:55:42,974 INFO [Listener at localhost/34517] regionserver.HRegion(2259): Starting compaction of 93b1e59720a53a032a804bf4ec0ce192/family2 in ns:testMinorCompaction,2,1699851325657.93b1e59720a53a032a804bf4ec0ce192. 2023-11-13 04:55:42,974 INFO [Listener at localhost/34517] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family2/85472854195a4b80947a16a08878010b, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family2/4ace6dc8ba4c4a39b3941818923fc2a3, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family2/47ca8fd753be4f89a5f65c47983f47de, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family2/ba8d82d3b67a468ca6212b44c87aa36b, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family2/348a60664e20417baabfa70ccd7994de] into tmpdir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/.tmp, totalSize=25.3 K 2023-11-13 04:55:42,974 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 85472854195a4b80947a16a08878010b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699851327772 2023-11-13 04:55:42,974 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 4ace6dc8ba4c4a39b3941818923fc2a3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699851329566 2023-11-13 04:55:42,975 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 47ca8fd753be4f89a5f65c47983f47de, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699851331369 2023-11-13 04:55:42,975 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting ba8d82d3b67a468ca6212b44c87aa36b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699851333168 2023-11-13 04:55:42,975 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 348a60664e20417baabfa70ccd7994de, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-13 04:55:42,986 INFO [Listener at localhost/34517] throttle.PressureAwareThroughputController(145): 93b1e59720a53a032a804bf4ec0ce192#family2#compaction#154 average throughput is 0.20 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-13 04:55:43,014 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family1/30450d58c37146cfa37a0d92be436333, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family1/8b1521a886b642d4825b601b79e90f9b, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family1/a70191158cbb42208b0d6df283eb069a, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family1/93259733ec5a422780fb9c8505446f27, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family1/950a7b9594a44a9c9f7cf0edfecc8aff] to archive 2023-11-13 04:55:43,015 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:55:43,016 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family1/30450d58c37146cfa37a0d92be436333 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family1/30450d58c37146cfa37a0d92be436333 2023-11-13 04:55:43,017 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family1/8b1521a886b642d4825b601b79e90f9b to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family1/8b1521a886b642d4825b601b79e90f9b 2023-11-13 04:55:43,018 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family1/a70191158cbb42208b0d6df283eb069a to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family1/a70191158cbb42208b0d6df283eb069a 2023-11-13 04:55:43,019 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family1/93259733ec5a422780fb9c8505446f27 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family1/93259733ec5a422780fb9c8505446f27 2023-11-13 04:55:43,020 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family1/950a7b9594a44a9c9f7cf0edfecc8aff to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family1/950a7b9594a44a9c9f7cf0edfecc8aff 2023-11-13 04:55:43,398 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023111367e24f1bf8284d7c9d5bf128e56e3a7c_del 2023-11-13 04:55:43,399 INFO [Listener at localhost/34517] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111367e24f1bf8284d7c9d5bf128e56e3a7c_del to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023111367e24f1bf8284d7c9d5bf128e56e3a7c_del 2023-11-13 04:55:43,410 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 849b938d52e3417085d0f6d6519f779d 2023-11-13 04:55:43,411 DEBUG [Listener at localhost/34517] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/.tmp/family2/849b938d52e3417085d0f6d6519f779d as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family2/849b938d52e3417085d0f6d6519f779d 2023-11-13 04:55:43,414 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 849b938d52e3417085d0f6d6519f779d 2023-11-13 04:55:43,414 INFO [Listener at localhost/34517] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 93b1e59720a53a032a804bf4ec0ce192/family2 of 93b1e59720a53a032a804bf4ec0ce192 into 849b938d52e3417085d0f6d6519f779d(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-13 04:55:43,415 DEBUG [Listener at localhost/34517] regionserver.HRegion(2289): Compaction status journal for 93b1e59720a53a032a804bf4ec0ce192: 2023-11-13 04:55:43,417 DEBUG [Listener at localhost/34517] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-13 04:55:43,420 DEBUG [Listener at localhost/34517] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-13 04:55:43,423 DEBUG [Listener at localhost/34517] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-13 04:55:43,424 DEBUG [Listener at localhost/34517] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-13 04:55:43,429 INFO [Listener at localhost/34517] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-13 04:55:43,441 INFO [Listener at localhost/34517] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-11-13 04:55:43,443 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231113c2ff3ee681bd449e9a22ee27af8355ba_del 2023-11-13 04:55:43,446 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202311137c265726c33b4e7daa0836724c17c8eb_del 2023-11-13 04:55:43,449 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311139fa0e63224e74161844d4f21739c0efb_del 2023-11-13 04:55:43,449 INFO [Listener at localhost/34517] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-11-13 04:55:43,450 DEBUG [Listener at localhost/34517] zookeeper.ReadOnlyZKClient(139): Connect 0x1e55ec38 to 127.0.0.1:51072 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-13 04:55:43,454 DEBUG [Listener at localhost/34517] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@59e76318, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-13 04:55:43,455 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231113 for table='ns:testMinorCompaction' and column='family1' 2023-11-13 04:55:43,455 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231113 for table='ns:testMinorCompaction' and column='family1' 2023-11-13 04:55:43,455 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231113 for table='ns:testMinorCompaction' and column='family1' 2023-11-13 04:55:43,517 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family2/85472854195a4b80947a16a08878010b, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family2/4ace6dc8ba4c4a39b3941818923fc2a3, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family2/47ca8fd753be4f89a5f65c47983f47de, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family2/ba8d82d3b67a468ca6212b44c87aa36b, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family2/348a60664e20417baabfa70ccd7994de] to archive 2023-11-13 04:55:43,518 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:55:43,520 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family2/85472854195a4b80947a16a08878010b to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family2/85472854195a4b80947a16a08878010b 2023-11-13 04:55:43,521 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family2/4ace6dc8ba4c4a39b3941818923fc2a3 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family2/4ace6dc8ba4c4a39b3941818923fc2a3 2023-11-13 04:55:43,522 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family2/47ca8fd753be4f89a5f65c47983f47de to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family2/47ca8fd753be4f89a5f65c47983f47de 2023-11-13 04:55:43,523 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family2/ba8d82d3b67a468ca6212b44c87aa36b to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family2/ba8d82d3b67a468ca6212b44c87aa36b 2023-11-13 04:55:43,524 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family2/348a60664e20417baabfa70ccd7994de to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family2/348a60664e20417baabfa70ccd7994de 2023-11-13 04:55:43,886 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231113fdd1a5eef8a540cd99728d934d6a7d20 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231113fdd1a5eef8a540cd99728d934d6a7d20 2023-11-13 04:55:43,887 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231113 table='ns:testMinorCompaction' column='family1' 2023-11-13 04:55:43,888 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231113cef85859c4b94c9e9e52653a3658797d to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231113cef85859c4b94c9e9e52653a3658797d 2023-11-13 04:55:43,889 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231113 table='ns:testMinorCompaction' column='family1' 2023-11-13 04:55:43,904 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-13 04:55:43,907 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56196, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-13 04:55:43,913 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-13 04:55:43,915 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56012, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-13 04:55:43,925 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231113/family1/3bb8a90f1b73439191ec29826274a0b6 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-11-13 04:55:43,926 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231113/family1/02f67d0336cf4f00a78cd6887fa5943f first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-11-13 04:55:43,926 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,,1699851325657.beccf4b9bb7f1b9d4214b816ec12c591., hostname=jenkins-hbase4.apache.org,41657,1699851201532, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231113/family1/3bb8a90f1b73439191ec29826274a0b6}] 2023-11-13 04:55:43,927 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,1,1699851325657.69269bc0d44ad4030e108151ca591d2f., hostname=jenkins-hbase4.apache.org,41657,1699851201532, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231113/family1/02f67d0336cf4f00a78cd6887fa5943f}] 2023-11-13 04:55:43,933 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(763): Validating hfile at hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231113/family1/02f67d0336cf4f00a78cd6887fa5943f for inclusion in 69269bc0d44ad4030e108151ca591d2f/family1 2023-11-13 04:55:43,934 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(763): Validating hfile at hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231113/family1/3bb8a90f1b73439191ec29826274a0b6 for inclusion in beccf4b9bb7f1b9d4214b816ec12c591/family1 2023-11-13 04:55:43,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-11-13 04:55:43,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-13 04:55:43,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HRegion(2446): Flush status journal for 69269bc0d44ad4030e108151ca591d2f: 2023-11-13 04:55:43,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-11-13 04:55:43,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(777): Region bounds: first= last=1 2023-11-13 04:55:43,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HRegion(2446): Flush status journal for beccf4b9bb7f1b9d4214b816ec12c591: 2023-11-13 04:55:43,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231113/family1/02f67d0336cf4f00a78cd6887fa5943f to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__ns_testMinorCompaction__s4pg21a6ph1kde6jbqi4ok90je4n71jmns0de01k8mqnsvcs7276q7ebpar7bcct/family1/02f67d0336cf4f00a78cd6887fa5943f 2023-11-13 04:55:43,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231113/family1/3bb8a90f1b73439191ec29826274a0b6 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__ns_testMinorCompaction__r1vbvci40avlaqt15msr9b0ab158pgh6rg4mgoet6uuno7krbg8vbicp550iri56/family1/3bb8a90f1b73439191ec29826274a0b6 2023-11-13 04:55:43,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__ns_testMinorCompaction__s4pg21a6ph1kde6jbqi4ok90je4n71jmns0de01k8mqnsvcs7276q7ebpar7bcct/family1/02f67d0336cf4f00a78cd6887fa5943f as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family1/608824fd537a42f8b461cd49c90b3bbf_SeqId_28_ 2023-11-13 04:55:43,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__ns_testMinorCompaction__r1vbvci40avlaqt15msr9b0ab158pgh6rg4mgoet6uuno7krbg8vbicp550iri56/family1/3bb8a90f1b73439191ec29826274a0b6 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family1/346369f679fa4dc3b955ea8515384efb_SeqId_28_ 2023-11-13 04:55:43,939 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(849): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__ns_testMinorCompaction__s4pg21a6ph1kde6jbqi4ok90je4n71jmns0de01k8mqnsvcs7276q7ebpar7bcct/family1/02f67d0336cf4f00a78cd6887fa5943f into 69269bc0d44ad4030e108151ca591d2f/family1 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family1/608824fd537a42f8b461cd49c90b3bbf_SeqId_28_ - updating store file list. 2023-11-13 04:55:43,940 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(849): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__ns_testMinorCompaction__r1vbvci40avlaqt15msr9b0ab158pgh6rg4mgoet6uuno7krbg8vbicp550iri56/family1/3bb8a90f1b73439191ec29826274a0b6 into beccf4b9bb7f1b9d4214b816ec12c591/family1 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family1/346369f679fa4dc3b955ea8515384efb_SeqId_28_ - updating store file list. 2023-11-13 04:55:43,943 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(882): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family1/608824fd537a42f8b461cd49c90b3bbf_SeqId_28_ into 69269bc0d44ad4030e108151ca591d2f/family1 2023-11-13 04:55:43,943 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(855): Successfully loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__ns_testMinorCompaction__s4pg21a6ph1kde6jbqi4ok90je4n71jmns0de01k8mqnsvcs7276q7ebpar7bcct/family1/02f67d0336cf4f00a78cd6887fa5943f into 69269bc0d44ad4030e108151ca591d2f/family1 (new location: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/family1/608824fd537a42f8b461cd49c90b3bbf_SeqId_28_) 2023-11-13 04:55:43,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__ns_testMinorCompaction__s4pg21a6ph1kde6jbqi4ok90je4n71jmns0de01k8mqnsvcs7276q7ebpar7bcct/family1/02f67d0336cf4f00a78cd6887fa5943f 2023-11-13 04:55:43,944 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(882): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family1/346369f679fa4dc3b955ea8515384efb_SeqId_28_ into beccf4b9bb7f1b9d4214b816ec12c591/family1 2023-11-13 04:55:43,944 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.HStore(855): Successfully loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__ns_testMinorCompaction__r1vbvci40avlaqt15msr9b0ab158pgh6rg4mgoet6uuno7krbg8vbicp550iri56/family1/3bb8a90f1b73439191ec29826274a0b6 into beccf4b9bb7f1b9d4214b816ec12c591/family1 (new location: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/family1/346369f679fa4dc3b955ea8515384efb_SeqId_28_) 2023-11-13 04:55:43,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__ns_testMinorCompaction__r1vbvci40avlaqt15msr9b0ab158pgh6rg4mgoet6uuno7krbg8vbicp550iri56/family1/3bb8a90f1b73439191ec29826274a0b6 2023-11-13 04:55:43,947 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231113 table='ns:testMinorCompaction' column='family1' 2023-11-13 04:55:43,947 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231113 table='ns:testMinorCompaction' column='family1' 2023-11-13 04:55:43,947 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:55:43,948 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:55:43,949 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202311135e48814824be4072a43b765f2e9ed49f to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202311135e48814824be4072a43b765f2e9ed49f 2023-11-13 04:55:43,949 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-13 04:55:43,949 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231113' 2023-11-13 04:55:43,949 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023111351b8c4022a1a45c090be6b8974d06337 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023111351b8c4022a1a45c090be6b8974d06337 2023-11-13 04:55:43,950 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-13 04:55:43,950 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231113 for table='ns:testMinorCompaction' and column='family1' 2023-11-13 04:55:43,950 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231113' 2023-11-13 04:55:43,950 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231113 for table='ns:testMinorCompaction' and column='family1' 2023-11-13 04:55:44,288 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111375770db22e3648cbb811ec89630de571 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023111375770db22e3648cbb811ec89630de571 2023-11-13 04:55:44,289 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231113 table='ns:testMinorCompaction' column='family1' 2023-11-13 04:55:44,315 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231113/family1/6c8764d27e4c4c368417e6b17d98d954 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-11-13 04:55:44,316 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,2,1699851325657.93b1e59720a53a032a804bf4ec0ce192., hostname=jenkins-hbase4.apache.org,41657,1699851201532, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231113/family1/6c8764d27e4c4c368417e6b17d98d954}] 2023-11-13 04:55:44,318 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(763): Validating hfile at hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231113/family1/6c8764d27e4c4c368417e6b17d98d954 for inclusion in 93b1e59720a53a032a804bf4ec0ce192/family1 2023-11-13 04:55:44,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-11-13 04:55:44,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-13 04:55:44,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HRegion(2446): Flush status journal for 93b1e59720a53a032a804bf4ec0ce192: 2023-11-13 04:55:44,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231113/family1/6c8764d27e4c4c368417e6b17d98d954 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__ns_testMinorCompaction__cmk9m63kmrllefcrjl8sk91ecr6th9tduj7unopjichb1lainm2s0hi6fm41q2rh/family1/6c8764d27e4c4c368417e6b17d98d954 2023-11-13 04:55:44,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__ns_testMinorCompaction__cmk9m63kmrllefcrjl8sk91ecr6th9tduj7unopjichb1lainm2s0hi6fm41q2rh/family1/6c8764d27e4c4c368417e6b17d98d954 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family1/d366ff1fa01b4e66bbd78e9e8c9a057b_SeqId_28_ 2023-11-13 04:55:44,322 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(849): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__ns_testMinorCompaction__cmk9m63kmrllefcrjl8sk91ecr6th9tduj7unopjichb1lainm2s0hi6fm41q2rh/family1/6c8764d27e4c4c368417e6b17d98d954 into 93b1e59720a53a032a804bf4ec0ce192/family1 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family1/d366ff1fa01b4e66bbd78e9e8c9a057b_SeqId_28_ - updating store file list. 2023-11-13 04:55:44,325 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(882): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family1/d366ff1fa01b4e66bbd78e9e8c9a057b_SeqId_28_ into 93b1e59720a53a032a804bf4ec0ce192/family1 2023-11-13 04:55:44,325 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(855): Successfully loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__ns_testMinorCompaction__cmk9m63kmrllefcrjl8sk91ecr6th9tduj7unopjichb1lainm2s0hi6fm41q2rh/family1/6c8764d27e4c4c368417e6b17d98d954 into 93b1e59720a53a032a804bf4ec0ce192/family1 (new location: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/family1/d366ff1fa01b4e66bbd78e9e8c9a057b_SeqId_28_) 2023-11-13 04:55:44,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__ns_testMinorCompaction__cmk9m63kmrllefcrjl8sk91ecr6th9tduj7unopjichb1lainm2s0hi6fm41q2rh/family1/6c8764d27e4c4c368417e6b17d98d954 2023-11-13 04:55:44,327 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231113 table='ns:testMinorCompaction' column='family1' 2023-11-13 04:55:44,327 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:55:44,328 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231113649f06c3635c42569a6b69fc9418ee78 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231113649f06c3635c42569a6b69fc9418ee78 2023-11-13 04:55:44,328 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-13 04:55:44,328 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231113' 2023-11-13 04:55:44,329 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231113 for table='ns:testMinorCompaction' and column='family1' 2023-11-13 04:55:44,329 INFO [Listener at localhost/34517] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-11-13 04:55:44,331 DEBUG [Listener at localhost/34517] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-13 04:55:44,332 DEBUG [Listener at localhost/34517] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-13 04:55:44,335 DEBUG [Listener at localhost/34517] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-13 04:55:44,335 DEBUG [Listener at localhost/34517] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-13 04:55:44,351 INFO [Listener at localhost/34517] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=252 (was 286), OpenFileDescriptor=662 (was 788), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=122 (was 132), ProcessCount=167 (was 167), AvailableMemoryMB=2841 (was 2821) - AvailableMemoryMB LEAK? - 2023-11-13 04:55:44,362 INFO [Listener at localhost/34517] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=252, OpenFileDescriptor=662, MaxFileDescriptor=60000, SystemLoadAverage=122, ProcessCount=167, AvailableMemoryMB=2841 2023-11-13 04:55:44,364 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-13 04:55:44,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:44,366 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-13 04:55:44,366 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-11-13 04:55:44,366 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-13 04:55:44,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-13 04:55:44,367 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315 2023-11-13 04:55:44,368 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315 empty. 2023-11-13 04:55:44,368 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315 2023-11-13 04:55:44,368 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-11-13 04:55:44,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-13 04:55:44,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-13 04:55:44,775 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-13 04:55:44,776 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => d39756ba701219092d4f35836804d315, NAME => 'testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp 2023-11-13 04:55:44,781 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-13 04:55:44,781 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing d39756ba701219092d4f35836804d315, disabling compactions & flushes 2023-11-13 04:55:44,781 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315. 2023-11-13 04:55:44,781 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315. 2023-11-13 04:55:44,781 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315. after waiting 0 ms 2023-11-13 04:55:44,781 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315. 2023-11-13 04:55:44,781 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315. 2023-11-13 04:55:44,781 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for d39756ba701219092d4f35836804d315: 2023-11-13 04:55:44,783 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-13 04:55:44,784 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1699851344784"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699851344784"}]},"ts":"1699851344784"} 2023-11-13 04:55:44,786 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-13 04:55:44,786 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-13 04:55:44,787 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699851344786"}]},"ts":"1699851344786"} 2023-11-13 04:55:44,787 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-11-13 04:55:44,791 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=d39756ba701219092d4f35836804d315, ASSIGN}] 2023-11-13 04:55:44,792 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=d39756ba701219092d4f35836804d315, ASSIGN 2023-11-13 04:55:44,792 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=d39756ba701219092d4f35836804d315, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41657,1699851201532; forceNewPlan=false, retain=false 2023-11-13 04:55:44,943 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=d39756ba701219092d4f35836804d315, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:44,944 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1699851344943"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699851344943"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699851344943"}]},"ts":"1699851344943"} 2023-11-13 04:55:44,945 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure d39756ba701219092d4f35836804d315, server=jenkins-hbase4.apache.org,41657,1699851201532}] 2023-11-13 04:55:44,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-13 04:55:45,097 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:45,099 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315. 2023-11-13 04:55:45,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d39756ba701219092d4f35836804d315, NAME => 'testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315.', STARTKEY => '', ENDKEY => ''} 2023-11-13 04:55:45,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy d39756ba701219092d4f35836804d315 2023-11-13 04:55:45,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-13 04:55:45,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d39756ba701219092d4f35836804d315 2023-11-13 04:55:45,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d39756ba701219092d4f35836804d315 2023-11-13 04:55:45,102 INFO [StoreOpener-d39756ba701219092d4f35836804d315-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d39756ba701219092d4f35836804d315 2023-11-13 04:55:45,103 DEBUG [StoreOpener-d39756ba701219092d4f35836804d315-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1 2023-11-13 04:55:45,103 DEBUG [StoreOpener-d39756ba701219092d4f35836804d315-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1 2023-11-13 04:55:45,103 INFO [StoreOpener-d39756ba701219092d4f35836804d315-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d39756ba701219092d4f35836804d315 columnFamilyName family1 2023-11-13 04:55:45,104 INFO [StoreOpener-d39756ba701219092d4f35836804d315-1] regionserver.HStore(310): Store=d39756ba701219092d4f35836804d315/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-13 04:55:45,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315 2023-11-13 04:55:45,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315 2023-11-13 04:55:45,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d39756ba701219092d4f35836804d315 2023-11-13 04:55:45,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-13 04:55:45,110 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d39756ba701219092d4f35836804d315; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69182262, jitterRate=0.030896037817001343}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-13 04:55:45,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d39756ba701219092d4f35836804d315: 2023-11-13 04:55:45,110 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315., pid=114, masterSystemTime=1699851345097 2023-11-13 04:55:45,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315. 2023-11-13 04:55:45,111 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315. 2023-11-13 04:55:45,112 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=d39756ba701219092d4f35836804d315, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:45,112 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1699851345112"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699851345112"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699851345112"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699851345112"}]},"ts":"1699851345112"} 2023-11-13 04:55:45,114 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=114, resume processing ppid=113 2023-11-13 04:55:45,114 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure d39756ba701219092d4f35836804d315, server=jenkins-hbase4.apache.org,41657,1699851201532 in 168 msec 2023-11-13 04:55:45,115 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=113, resume processing ppid=112 2023-11-13 04:55:45,116 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=d39756ba701219092d4f35836804d315, ASSIGN in 323 msec 2023-11-13 04:55:45,116 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-13 04:55:45,116 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699851345116"}]},"ts":"1699851345116"} 2023-11-13 04:55:45,117 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-11-13 04:55:45,119 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-13 04:55:45,120 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 755 msec 2023-11-13 04:55:45,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-13 04:55:45,471 INFO [Listener at localhost/34517] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-11-13 04:55:45,487 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:55:45,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:45,489 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-13 04:55:45,489 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:55:45,489 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-13 04:55:45,489 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-13 04:55:45,489 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:45,490 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:45,491 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:55:45,491 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:45,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:55:45,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:55:45,492 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:45,492 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:55:45,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:45,492 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:45,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:55:45,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:45,493 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:45,493 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:45,493 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-13 04:55:45,493 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:55:45,493 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-13 04:55:45,493 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:55:45,493 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:55:45,493 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315. 2023-11-13 04:55:45,493 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315. started... 2023-11-13 04:55:45,494 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d39756ba701219092d4f35836804d315 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-13 04:55:45,915 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130edc5df0d80fb4538a886cc0f23a77433 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130edc5df0d80fb4538a886cc0f23a77433 2023-11-13 04:55:46,318 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/.tmp/family1/328ae011211a4df2a564738048efcafc 2023-11-13 04:55:46,323 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/.tmp/family1/328ae011211a4df2a564738048efcafc as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/328ae011211a4df2a564738048efcafc 2023-11-13 04:55:46,326 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/328ae011211a4df2a564738048efcafc, entries=1000, sequenceid=5, filesize=166.0 K 2023-11-13 04:55:46,327 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for d39756ba701219092d4f35836804d315 in 833ms, sequenceid=5, compaction requested=false 2023-11-13 04:55:46,327 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-11-13 04:55:46,328 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d39756ba701219092d4f35836804d315: 2023-11-13 04:55:46,328 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315. 2023-11-13 04:55:46,328 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:55:46,328 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:55:46,328 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:46,328 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-13 04:55:46,328 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-13 04:55:46,333 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:46,333 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:46,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:46,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:46,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:46,333 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:46,333 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:55:46,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:46,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:46,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:46,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:46,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:46,335 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-13 04:55:46,335 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3cb1e80b[Count = 0] remaining members to acquire global barrier 2023-11-13 04:55:46,335 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-13 04:55:46,335 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:46,336 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:46,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:46,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:46,336 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-13 04:55:46,336 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-13 04:55:46,336 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:46,336 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:55:46,336 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:55:46,340 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:46,340 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-13 04:55:46,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:46,340 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:55:46,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:46,340 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-13 04:55:46,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:46,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:46,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:46,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:46,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:46,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:46,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:46,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:46,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:55:46,342 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-13 04:55:46,342 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-13 04:55:46,342 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:55:46,342 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:55:46,342 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:46,342 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:55:46,344 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:46,344 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:46,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:46,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:46,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:46,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:46,344 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:55:46,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:46,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:46,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:55:46,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:55:46,345 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:46,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:46,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:46,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:46,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:46,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:46,346 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:46,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:46,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:46,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:46,348 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:46,348 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:46,348 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:55:46,348 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:46,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:55:46,348 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:55:46,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:55:46,348 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:46,348 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-13 04:55:46,349 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:55:46,348 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:55:46,349 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:46,349 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:46,349 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:46,349 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-13 04:55:46,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:55:46,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:55:46,349 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:55:46,449 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:55:46,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:55:46,454 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:55:46,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-13 04:55:46,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:46,456 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-13 04:55:46,456 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:55:46,456 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-13 04:55:46,456 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-13 04:55:46,456 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:46,456 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:46,458 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:46,458 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:55:46,458 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:55:46,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:55:46,458 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:46,458 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:55:46,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:46,459 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:46,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:55:46,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:46,459 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:46,459 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-13 04:55:46,459 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:46,459 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-13 04:55:46,459 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:55:46,459 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-13 04:55:46,459 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:55:46,460 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:55:46,460 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315. 2023-11-13 04:55:46,460 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315. started... 2023-11-13 04:55:46,460 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d39756ba701219092d4f35836804d315 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-13 04:55:46,871 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128758062c41f904c9ea35cf63a817d0b09 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128758062c41f904c9ea35cf63a817d0b09 2023-11-13 04:55:47,275 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/.tmp/family1/3fa695bc2af34a0ab4f97993b9770d0a 2023-11-13 04:55:47,279 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/.tmp/family1/3fa695bc2af34a0ab4f97993b9770d0a as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/3fa695bc2af34a0ab4f97993b9770d0a 2023-11-13 04:55:47,282 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/3fa695bc2af34a0ab4f97993b9770d0a, entries=1, sequenceid=9, filesize=5.0 K 2023-11-13 04:55:47,283 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for d39756ba701219092d4f35836804d315 in 823ms, sequenceid=9, compaction requested=false 2023-11-13 04:55:47,283 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d39756ba701219092d4f35836804d315: 2023-11-13 04:55:47,283 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315. 2023-11-13 04:55:47,283 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:55:47,283 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:55:47,283 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:47,283 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-13 04:55:47,283 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-13 04:55:47,286 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:47,286 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:47,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:47,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:47,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:47,286 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:47,286 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:55:47,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:47,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:47,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:47,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:47,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:47,287 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-13 04:55:47,287 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6ec3aae0[Count = 0] remaining members to acquire global barrier 2023-11-13 04:55:47,287 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-13 04:55:47,287 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:47,288 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:47,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:47,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:47,289 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-13 04:55:47,289 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-13 04:55:47,289 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:55:47,289 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:47,289 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:55:47,291 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:47,291 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-13 04:55:47,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:47,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:47,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:47,291 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:55:47,291 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-13 04:55:47,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:47,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:47,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:47,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:47,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:47,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:47,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:47,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:55:47,293 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-13 04:55:47,293 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-13 04:55:47,293 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:55:47,293 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:55:47,293 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:47,293 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:55:47,295 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:47,295 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:47,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:47,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:47,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:47,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:47,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:47,295 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:55:47,295 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:47,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:55:47,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:55:47,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:47,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:47,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:47,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:47,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:47,297 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:47,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:47,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:47,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:47,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:47,299 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:47,299 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:55:47,299 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:47,299 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:55:47,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:55:47,300 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-13 04:55:47,300 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:55:47,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:55:47,299 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:55:47,299 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-13 04:55:47,299 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:47,300 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:47,300 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:47,300 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-13 04:55:47,300 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:47,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:55:47,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:55:47,300 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:55:47,300 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:47,400 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:55:47,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:55:47,405 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:55:47,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-13 04:55:47,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:47,406 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-13 04:55:47,406 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:55:47,406 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-13 04:55:47,406 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-13 04:55:47,407 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:47,407 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:47,408 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:47,408 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:55:47,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:55:47,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:55:47,408 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:47,409 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:55:47,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:47,409 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:47,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:55:47,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:47,409 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:47,409 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-13 04:55:47,410 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:47,410 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-13 04:55:47,410 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:55:47,410 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-13 04:55:47,410 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:55:47,410 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:55:47,410 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315. 2023-11-13 04:55:47,410 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315. started... 2023-11-13 04:55:47,410 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d39756ba701219092d4f35836804d315 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:55:47,821 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201e1815b3b4d3a4885ae17978e3634f6e0 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201e1815b3b4d3a4885ae17978e3634f6e0 2023-11-13 04:55:48,226 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/.tmp/family1/b7d37ad4e8ae44369c6476e5b54c025e 2023-11-13 04:55:48,230 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/.tmp/family1/b7d37ad4e8ae44369c6476e5b54c025e as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/b7d37ad4e8ae44369c6476e5b54c025e 2023-11-13 04:55:48,233 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/b7d37ad4e8ae44369c6476e5b54c025e, entries=1, sequenceid=13, filesize=4.9 K 2023-11-13 04:55:48,234 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d39756ba701219092d4f35836804d315 in 824ms, sequenceid=13, compaction requested=true 2023-11-13 04:55:48,234 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d39756ba701219092d4f35836804d315: 2023-11-13 04:55:48,234 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315. 2023-11-13 04:55:48,234 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:55:48,234 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:55:48,234 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:48,234 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-13 04:55:48,234 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-13 04:55:48,235 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:48,236 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:48,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:48,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:48,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:48,236 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:48,236 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:55:48,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:48,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:48,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:48,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:48,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:48,237 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-13 04:55:48,237 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9b423a0[Count = 0] remaining members to acquire global barrier 2023-11-13 04:55:48,237 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-13 04:55:48,237 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:48,238 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:48,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:48,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:48,239 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-13 04:55:48,239 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-13 04:55:48,239 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:48,239 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:55:48,239 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:55:48,241 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-13 04:55:48,241 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:48,241 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:55:48,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:48,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:48,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:48,241 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-13 04:55:48,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:48,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:48,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:48,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:48,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:48,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:48,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:48,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:55:48,243 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-13 04:55:48,243 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-13 04:55:48,243 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:55:48,243 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:55:48,243 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:48,243 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:55:48,245 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:48,245 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:48,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:48,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:48,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:48,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:48,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:48,245 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:55:48,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:55:48,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:48,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:55:48,246 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:48,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:48,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:48,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:48,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:48,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:48,247 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:48,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:48,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:48,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:48,252 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:48,252 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:55:48,252 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:48,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:55:48,253 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-13 04:55:48,253 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:55:48,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:55:48,253 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:55:48,253 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:48,252 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:55:48,253 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:48,253 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:48,253 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:48,253 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:48,253 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-13 04:55:48,253 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:55:48,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:55:48,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:55:48,353 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:55:48,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:55:48,357 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:55:48,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-13 04:55:48,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:48,359 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-13 04:55:48,359 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:55:48,359 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-13 04:55:48,359 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-13 04:55:48,359 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:48,359 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:48,362 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:48,362 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:55:48,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:55:48,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:55:48,362 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:48,362 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:55:48,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:48,362 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:48,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:55:48,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:48,363 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:48,363 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-13 04:55:48,363 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:48,363 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-13 04:55:48,363 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:55:48,363 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-13 04:55:48,363 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:55:48,363 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:55:48,363 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315. 2023-11-13 04:55:48,364 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315. started... 2023-11-13 04:55:48,364 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d39756ba701219092d4f35836804d315 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:55:48,774 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205ca7962ec274a43e7a7736d18544cf2d0 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205ca7962ec274a43e7a7736d18544cf2d0 2023-11-13 04:55:49,179 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/.tmp/family1/13ab6cd9576c403b91ccaaa1f382a132 2023-11-13 04:55:49,182 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/.tmp/family1/13ab6cd9576c403b91ccaaa1f382a132 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/13ab6cd9576c403b91ccaaa1f382a132 2023-11-13 04:55:49,186 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/13ab6cd9576c403b91ccaaa1f382a132, entries=1, sequenceid=17, filesize=4.9 K 2023-11-13 04:55:49,187 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d39756ba701219092d4f35836804d315 in 822ms, sequenceid=17, compaction requested=true 2023-11-13 04:55:49,187 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d39756ba701219092d4f35836804d315: 2023-11-13 04:55:49,187 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315. 2023-11-13 04:55:49,187 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:55:49,187 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:55:49,187 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:49,187 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-13 04:55:49,187 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-13 04:55:49,189 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:49,189 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:49,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:49,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:49,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:49,190 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:49,190 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:55:49,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:49,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:49,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:49,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:49,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:49,191 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-13 04:55:49,191 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@24e3da59[Count = 0] remaining members to acquire global barrier 2023-11-13 04:55:49,191 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-13 04:55:49,191 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:49,192 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:49,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:49,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:49,192 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-13 04:55:49,192 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-13 04:55:49,192 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:55:49,193 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:49,193 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:55:49,194 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:49,194 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-13 04:55:49,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:49,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:49,194 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:55:49,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:49,194 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-13 04:55:49,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:49,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:49,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:49,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:49,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:49,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:49,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:49,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:55:49,196 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-13 04:55:49,196 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-13 04:55:49,196 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:55:49,196 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:55:49,196 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:49,196 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:55:49,198 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:49,198 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:55:49,198 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:49,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:49,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:49,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:49,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:49,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:49,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:49,198 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:49,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:55:49,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:55:49,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:49,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:49,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:49,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:49,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:49,199 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:49,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:49,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:49,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:49,203 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:49,203 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:49,203 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:55:49,203 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-13 04:55:49,203 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:55:49,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:55:49,203 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:55:49,203 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:55:49,203 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:49,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:55:49,204 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:49,204 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-13 04:55:49,204 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:49,204 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:55:49,204 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:49,204 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:49,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:55:49,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:55:49,304 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:55:49,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:55:49,308 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:55:49,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-13 04:55:49,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:49,310 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-13 04:55:49,310 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:55:49,310 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-13 04:55:49,310 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-13 04:55:49,310 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:49,310 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:49,312 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:55:49,312 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:49,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:55:49,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:55:49,312 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:49,312 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:55:49,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:49,312 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:49,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:55:49,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:49,313 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:49,313 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-13 04:55:49,313 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:49,313 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-13 04:55:49,313 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:55:49,313 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-13 04:55:49,313 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:55:49,313 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:55:49,313 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315. 2023-11-13 04:55:49,314 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315. started... 2023-11-13 04:55:49,314 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d39756ba701219092d4f35836804d315 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:55:49,724 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228b2f9e6ef2997451c9e7017bfcbb8faf5 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228b2f9e6ef2997451c9e7017bfcbb8faf5 2023-11-13 04:55:50,129 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/.tmp/family1/3bdca9df59bd4b298ac0c811086e5bdf 2023-11-13 04:55:50,133 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/.tmp/family1/3bdca9df59bd4b298ac0c811086e5bdf as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/3bdca9df59bd4b298ac0c811086e5bdf 2023-11-13 04:55:50,137 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/3bdca9df59bd4b298ac0c811086e5bdf, entries=1, sequenceid=21, filesize=4.9 K 2023-11-13 04:55:50,138 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d39756ba701219092d4f35836804d315 in 824ms, sequenceid=21, compaction requested=true 2023-11-13 04:55:50,138 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d39756ba701219092d4f35836804d315: 2023-11-13 04:55:50,138 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315. 2023-11-13 04:55:50,139 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:55:50,139 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:55:50,139 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:50,139 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-13 04:55:50,139 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-13 04:55:50,141 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:50,141 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:50,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:50,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:50,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:50,141 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:50,141 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:55:50,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:50,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:50,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:50,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:50,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:50,143 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-13 04:55:50,143 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@17a18f7e[Count = 0] remaining members to acquire global barrier 2023-11-13 04:55:50,143 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-13 04:55:50,143 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:50,144 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:50,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:50,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:50,144 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-13 04:55:50,144 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-13 04:55:50,144 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:55:50,144 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:50,145 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:55:50,147 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-13 04:55:50,147 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:55:50,147 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:50,147 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-13 04:55:50,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:50,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:50,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:50,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:50,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:50,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:50,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:50,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:50,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:50,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:50,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:55:50,150 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-13 04:55:50,150 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-13 04:55:50,150 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:55:50,150 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:55:50,150 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:50,150 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:55:50,151 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:50,151 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:50,152 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:55:50,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:50,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:50,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:50,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:50,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:50,152 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:50,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:50,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:55:50,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:55:50,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:50,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:50,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:50,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:50,153 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:50,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:50,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:50,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:50,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:50,156 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:50,156 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:50,156 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:50,156 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:50,156 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:50,156 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:55:50,156 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-13 04:55:50,156 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:55:50,156 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:50,156 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:55:50,156 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:50,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:55:50,156 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:55:50,156 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-13 04:55:50,156 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-13 04:55:50,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:55:50,157 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:55:50,157 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:55:50,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:55:50,257 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:55:50,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:55:50,261 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:55:50,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-13 04:55:50,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:50,263 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-13 04:55:50,263 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:55:50,263 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-13 04:55:50,263 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-13 04:55:50,263 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:50,263 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:50,265 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:50,265 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:55:50,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:55:50,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:55:50,265 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:50,265 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:55:50,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:50,265 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:50,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:55:50,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:50,266 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:50,266 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-13 04:55:50,266 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:50,266 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-13 04:55:50,266 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:55:50,266 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-13 04:55:50,266 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:55:50,266 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:55:50,266 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315. 2023-11-13 04:55:50,266 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315. started... 2023-11-13 04:55:50,266 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d39756ba701219092d4f35836804d315 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:55:50,639 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-13 04:55:50,678 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231095c9084739a4f2c90af9490f51fe6ea to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231095c9084739a4f2c90af9490f51fe6ea 2023-11-13 04:55:51,082 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/.tmp/family1/a0bd7ccde8494e29a587f83431c54f71 2023-11-13 04:55:51,086 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/.tmp/family1/a0bd7ccde8494e29a587f83431c54f71 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/a0bd7ccde8494e29a587f83431c54f71 2023-11-13 04:55:51,089 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/a0bd7ccde8494e29a587f83431c54f71, entries=1, sequenceid=25, filesize=4.9 K 2023-11-13 04:55:51,090 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d39756ba701219092d4f35836804d315 in 824ms, sequenceid=25, compaction requested=true 2023-11-13 04:55:51,090 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d39756ba701219092d4f35836804d315: 2023-11-13 04:55:51,090 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315. 2023-11-13 04:55:51,090 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:55:51,090 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:55:51,090 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:51,090 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-13 04:55:51,090 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-13 04:55:51,093 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:51,093 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:51,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:51,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:51,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:51,093 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:51,093 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:55:51,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:51,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:51,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:51,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:51,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:51,094 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-13 04:55:51,095 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@64c6b3c0[Count = 0] remaining members to acquire global barrier 2023-11-13 04:55:51,095 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-13 04:55:51,095 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:51,096 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:51,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:51,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:51,096 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-13 04:55:51,096 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-13 04:55:51,096 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:55:51,096 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:51,096 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:55:51,100 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:51,100 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-13 04:55:51,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:51,100 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:55:51,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:51,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:51,100 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-13 04:55:51,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:51,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:51,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:51,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:51,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:51,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:51,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:51,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:55:51,102 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-13 04:55:51,102 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-13 04:55:51,102 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:55:51,102 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:55:51,102 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:51,102 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:55:51,104 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:51,104 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:51,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:51,104 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:55:51,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:51,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:51,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:51,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:51,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:55:51,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:55:51,105 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:51,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:51,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:51,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:51,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:51,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:51,106 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:51,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:51,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:51,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:51,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:51,108 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:51,108 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:51,108 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:51,108 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:55:51,108 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:51,108 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:51,108 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-13 04:55:51,108 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:55:51,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:55:51,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:55:51,108 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:55:51,108 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-13 04:55:51,109 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-13 04:55:51,109 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:55:51,108 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:51,108 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:55:51,109 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:51,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:55:51,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:55:51,209 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:55:51,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:55:51,213 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:55:51,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-13 04:55:51,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:51,214 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-13 04:55:51,215 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:55:51,215 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-13 04:55:51,215 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-13 04:55:51,215 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:51,215 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:51,216 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:55:51,216 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:51,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:55:51,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:55:51,217 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:51,217 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:55:51,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:51,217 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:51,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:55:51,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:51,217 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:51,218 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-13 04:55:51,218 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:51,218 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-13 04:55:51,218 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:55:51,218 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-13 04:55:51,218 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:55:51,218 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:55:51,218 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315. 2023-11-13 04:55:51,218 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315. started... 2023-11-13 04:55:51,218 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d39756ba701219092d4f35836804d315 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:55:51,628 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010172b103e1438a444394e95c57f1bc8d4b to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010172b103e1438a444394e95c57f1bc8d4b 2023-11-13 04:55:52,033 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/.tmp/family1/67ce03a3091f41ceaa093d95d564483e 2023-11-13 04:55:52,037 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/.tmp/family1/67ce03a3091f41ceaa093d95d564483e as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/67ce03a3091f41ceaa093d95d564483e 2023-11-13 04:55:52,040 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/67ce03a3091f41ceaa093d95d564483e, entries=1, sequenceid=29, filesize=4.9 K 2023-11-13 04:55:52,041 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d39756ba701219092d4f35836804d315 in 823ms, sequenceid=29, compaction requested=true 2023-11-13 04:55:52,041 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d39756ba701219092d4f35836804d315: 2023-11-13 04:55:52,041 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315. 2023-11-13 04:55:52,041 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:55:52,041 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:55:52,041 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:52,041 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-13 04:55:52,041 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-13 04:55:52,043 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:52,043 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:52,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:52,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:52,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:52,043 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:52,043 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:55:52,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:52,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:52,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:52,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:52,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:52,045 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-13 04:55:52,045 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4cc725db[Count = 0] remaining members to acquire global barrier 2023-11-13 04:55:52,045 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-13 04:55:52,045 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:52,047 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:52,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:52,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:52,047 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-13 04:55:52,047 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-13 04:55:52,047 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:52,047 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:55:52,047 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:55:52,048 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:52,048 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-13 04:55:52,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:52,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:52,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:52,048 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:55:52,049 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-13 04:55:52,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:52,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:52,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:52,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:52,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:52,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:52,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:52,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:55:52,051 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-13 04:55:52,051 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-13 04:55:52,051 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:55:52,051 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:55:52,051 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:52,051 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:55:52,052 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:52,052 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:52,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:52,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:52,052 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:55:52,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:52,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:52,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:52,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:55:52,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:55:52,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:52,053 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:52,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:52,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:52,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:52,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:52,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:52,054 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:52,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:52,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:52,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:52,056 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:52,056 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:52,056 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:52,056 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:55:52,056 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-13 04:55:52,056 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:55:52,057 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:55:52,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:55:52,056 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:55:52,056 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:52,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:55:52,057 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:52,057 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-13 04:55:52,057 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:55:52,057 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:52,057 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:52,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:55:52,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:55:52,157 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:55:52,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:55:52,161 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:55:52,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-13 04:55:52,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:52,163 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-13 04:55:52,163 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:55:52,163 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-13 04:55:52,163 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-13 04:55:52,163 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:52,163 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:52,165 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:55:52,165 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:52,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:55:52,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:55:52,165 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:52,165 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:55:52,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:52,166 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:52,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:55:52,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:52,166 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:52,166 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-13 04:55:52,166 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:52,166 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-13 04:55:52,166 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:55:52,167 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-13 04:55:52,167 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:55:52,167 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:55:52,167 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315. 2023-11-13 04:55:52,167 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315. started... 2023-11-13 04:55:52,167 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d39756ba701219092d4f35836804d315 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:55:52,577 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601031a358d95d22444b8836587c0a0ac2fe8 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601031a358d95d22444b8836587c0a0ac2fe8 2023-11-13 04:55:52,982 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/.tmp/family1/00a35336eb244f8e8d0b1f96f7c622e4 2023-11-13 04:55:52,986 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/.tmp/family1/00a35336eb244f8e8d0b1f96f7c622e4 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/00a35336eb244f8e8d0b1f96f7c622e4 2023-11-13 04:55:52,989 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/00a35336eb244f8e8d0b1f96f7c622e4, entries=1, sequenceid=33, filesize=4.9 K 2023-11-13 04:55:52,990 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d39756ba701219092d4f35836804d315 in 823ms, sequenceid=33, compaction requested=true 2023-11-13 04:55:52,990 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d39756ba701219092d4f35836804d315: 2023-11-13 04:55:52,990 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315. 2023-11-13 04:55:52,990 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:55:52,990 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:55:52,990 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:52,990 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-13 04:55:52,990 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-13 04:55:52,992 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:52,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:52,992 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:52,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:52,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:52,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:52,992 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:52,992 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:55:52,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:52,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:52,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:52,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:52,994 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-13 04:55:52,994 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@764c0f08[Count = 0] remaining members to acquire global barrier 2023-11-13 04:55:52,994 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-13 04:55:52,994 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:52,995 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:52,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:52,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:52,995 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-13 04:55:52,995 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-13 04:55:52,995 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:52,995 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:55:52,995 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:55:52,997 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-13 04:55:52,997 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:52,997 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:55:52,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:52,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:52,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:52,997 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-13 04:55:52,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:52,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:52,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:52,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:52,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:52,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:52,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:52,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:55:52,999 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-13 04:55:52,999 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-13 04:55:52,999 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:55:52,999 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:55:52,999 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:52,999 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:55:53,001 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:53,002 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:53,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:53,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:53,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:53,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:53,002 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:55:53,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:53,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:55:53,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:55:53,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:53,002 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:53,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:53,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:53,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:53,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:53,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:53,003 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:53,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:53,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:53,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:53,006 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:53,006 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:55:53,006 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:53,006 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:55:53,006 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-13 04:55:53,006 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:55:53,006 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:55:53,006 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:53,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:55:53,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:55:53,006 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:53,006 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:53,006 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:53,006 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:53,006 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-13 04:55:53,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:55:53,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:55:53,006 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:55:53,106 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:55:53,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:55:53,111 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:55:53,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-13 04:55:53,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:53,112 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-13 04:55:53,112 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:55:53,112 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-13 04:55:53,112 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-13 04:55:53,113 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:53,113 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:53,114 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:55:53,114 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:53,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:55:53,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:55:53,115 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:53,115 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:55:53,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:53,115 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:53,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:55:53,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:53,115 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:53,116 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-13 04:55:53,116 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:53,116 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-13 04:55:53,116 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:55:53,116 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-13 04:55:53,116 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:55:53,116 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:55:53,116 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315. 2023-11-13 04:55:53,116 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315. started... 2023-11-13 04:55:53,116 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d39756ba701219092d4f35836804d315 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:55:53,528 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509078cc5ff38fbf64793ba6126d270d64224 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201509078cc5ff38fbf64793ba6126d270d64224 2023-11-13 04:55:53,933 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/.tmp/family1/384782d4d5f0416ba5c8270467c284eb 2023-11-13 04:55:53,937 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/.tmp/family1/384782d4d5f0416ba5c8270467c284eb as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/384782d4d5f0416ba5c8270467c284eb 2023-11-13 04:55:53,940 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/384782d4d5f0416ba5c8270467c284eb, entries=1, sequenceid=37, filesize=4.9 K 2023-11-13 04:55:53,941 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d39756ba701219092d4f35836804d315 in 825ms, sequenceid=37, compaction requested=true 2023-11-13 04:55:53,941 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d39756ba701219092d4f35836804d315: 2023-11-13 04:55:53,941 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315. 2023-11-13 04:55:53,941 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:55:53,941 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:55:53,941 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:53,941 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-13 04:55:53,941 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-13 04:55:53,947 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:53,947 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:53,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:53,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:53,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:53,947 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:53,947 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:55:53,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:53,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:53,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:53,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:53,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:53,948 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-13 04:55:53,948 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d8db4c0[Count = 0] remaining members to acquire global barrier 2023-11-13 04:55:53,948 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-13 04:55:53,949 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:53,950 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:53,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:53,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:53,950 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-13 04:55:53,950 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-13 04:55:53,950 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:55:53,950 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:53,950 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:55:53,951 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-13 04:55:53,951 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:55:53,951 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:53,951 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-13 04:55:53,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:53,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:53,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:53,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:53,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:53,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:53,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:53,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:53,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:53,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:53,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:55:53,954 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-13 04:55:53,954 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-13 04:55:53,954 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:55:53,954 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:55:53,954 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:53,954 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:55:53,955 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:53,955 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:53,955 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:55:53,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:53,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:53,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:53,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:53,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:53,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:53,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:55:53,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:55:53,956 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:53,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:53,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:53,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:53,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:53,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:53,957 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:53,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:53,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:53,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:53,961 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:55:53,961 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:55:53,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:55:53,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:55:53,961 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:53,961 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-13 04:55:53,961 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:55:53,961 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:55:53,961 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:53,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:55:53,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:55:53,961 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:53,961 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-13 04:55:53,961 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:55:53,961 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:53,961 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:53,961 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:53,961 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:54,061 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:55:54,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:55:54,066 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:55:54,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-13 04:55:54,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:54,067 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-13 04:55:54,067 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:55:54,067 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-13 04:55:54,067 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-13 04:55:54,068 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:54,068 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:54,069 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:54,069 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:55:54,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:55:54,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:55:54,069 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:54,069 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:55:54,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:54,070 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:54,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:55:54,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:54,070 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:54,070 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-13 04:55:54,070 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:54,070 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-13 04:55:54,070 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:55:54,070 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-13 04:55:54,070 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-13 04:55:54,070 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:55:54,071 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315. 2023-11-13 04:55:54,071 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315. started... 2023-11-13 04:55:54,071 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d39756ba701219092d4f35836804d315 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-13 04:55:54,481 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120919c5de5d78249bb811c9b253ac60e36 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120919c5de5d78249bb811c9b253ac60e36 2023-11-13 04:55:54,886 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/.tmp/family1/1e481145bc4a47b5a27ec169648debc5 2023-11-13 04:55:54,890 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/.tmp/family1/1e481145bc4a47b5a27ec169648debc5 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/1e481145bc4a47b5a27ec169648debc5 2023-11-13 04:55:54,893 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/1e481145bc4a47b5a27ec169648debc5, entries=1, sequenceid=41, filesize=4.9 K 2023-11-13 04:55:54,894 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d39756ba701219092d4f35836804d315 in 823ms, sequenceid=41, compaction requested=true 2023-11-13 04:55:54,894 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d39756ba701219092d4f35836804d315: 2023-11-13 04:55:54,894 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315. 2023-11-13 04:55:54,894 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-13 04:55:54,894 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-13 04:55:54,894 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:54,894 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-13 04:55:54,894 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-13 04:55:54,895 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:54,895 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:54,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:54,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:54,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:54,896 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:54,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:54,896 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:55:54,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:54,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:54,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:54,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:54,897 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-13 04:55:54,897 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c044202[Count = 0] remaining members to acquire global barrier 2023-11-13 04:55:54,897 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-13 04:55:54,897 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:54,898 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:54,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:54,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:54,899 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-13 04:55:54,899 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-13 04:55:54,899 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:55:54,899 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:54,899 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:55:54,900 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-13 04:55:54,900 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:55:54,900 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:54,900 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-13 04:55:54,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:54,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:54,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:54,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:54,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:54,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:54,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:54,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:54,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:54,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:54,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:55:54,902 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-13 04:55:54,902 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-13 04:55:54,903 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:55:54,903 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:55:54,903 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:54,903 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:55:54,905 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:54,905 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:55:54,905 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:54,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:54,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:54,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:54,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:54,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:54,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:55:54,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:55:54,906 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:54,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:54,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:54,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:54,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:54,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:54,907 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:54,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:54,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:54,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:54,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:54,909 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:54,909 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:55:54,909 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:54,909 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:55:54,909 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-13 04:55:54,909 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:55:54,909 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:54,909 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:55:54,909 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:55:54,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:55:54,909 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:54,909 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-13 04:55:54,910 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-13 04:55:54,909 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:54,910 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:55:54,910 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:54,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:55:54,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:55:54,910 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:55,010 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:55:55,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:55:55,012 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33831] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-11-13 04:55:55,013 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] procedure2.ProcedureExecutor(1028): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-13 04:55:55,014 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-13 04:55:55,015 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-13 04:55:55,015 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699851955015 2023-11-13 04:55:55,017 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-13 04:55:55,018 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-11-13 04:55:55,018 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-13 04:55:55,018 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] zookeeper.ReadOnlyZKClient(139): Connect 0x7f62dd6b to 127.0.0.1:51072 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-13 04:55:55,023 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e714ceb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-13 04:55:55,023 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-13 04:55:55,447 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601037cbdf63ad54e4ab294053dc8fa369a99 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601037cbdf63ad54e4ab294053dc8fa369a99 2023-11-13 04:55:55,449 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-13 04:55:55,461 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-13 04:55:55,463 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57022, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-13 04:55:55,470 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-13 04:55:55,471 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43156, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-13 04:55:55,479 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/6fc68a5873f342b2a5dae6ecd6d11841 first=Optional[r5] last=Optional[r6] 2023-11-13 04:55:55,479 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315., hostname=jenkins-hbase4.apache.org,41657,1699851201532, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/6fc68a5873f342b2a5dae6ecd6d11841}] 2023-11-13 04:55:55,483 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(763): Validating hfile at hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/6fc68a5873f342b2a5dae6ecd6d11841 for inclusion in d39756ba701219092d4f35836804d315/family1 2023-11-13 04:55:55,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-11-13 04:55:55,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(777): Region bounds: first= last= 2023-11-13 04:55:55,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HRegion(2446): Flush status journal for d39756ba701219092d4f35836804d315: 2023-11-13 04:55:55,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/6fc68a5873f342b2a5dae6ecd6d11841 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMinorCompactionWithMonthlyPolicy__i1omodofslrc6k4ou0b17ta09s9j2a2cqeg72vhl4ok9hvnd529gfkpoplti0meo/family1/6fc68a5873f342b2a5dae6ecd6d11841 2023-11-13 04:55:55,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMinorCompactionWithMonthlyPolicy__i1omodofslrc6k4ou0b17ta09s9j2a2cqeg72vhl4ok9hvnd529gfkpoplti0meo/family1/6fc68a5873f342b2a5dae6ecd6d11841 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/b39786a27c754a3d8eeb4155ce5ece12_SeqId_44_ 2023-11-13 04:55:55,488 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(849): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMinorCompactionWithMonthlyPolicy__i1omodofslrc6k4ou0b17ta09s9j2a2cqeg72vhl4ok9hvnd529gfkpoplti0meo/family1/6fc68a5873f342b2a5dae6ecd6d11841 into d39756ba701219092d4f35836804d315/family1 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/b39786a27c754a3d8eeb4155ce5ece12_SeqId_44_ - updating store file list. 2023-11-13 04:55:55,491 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(882): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/b39786a27c754a3d8eeb4155ce5ece12_SeqId_44_ into d39756ba701219092d4f35836804d315/family1 2023-11-13 04:55:55,491 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(855): Successfully loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMinorCompactionWithMonthlyPolicy__i1omodofslrc6k4ou0b17ta09s9j2a2cqeg72vhl4ok9hvnd529gfkpoplti0meo/family1/6fc68a5873f342b2a5dae6ecd6d11841 into d39756ba701219092d4f35836804d315/family1 (new location: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/b39786a27c754a3d8eeb4155ce5ece12_SeqId_44_) 2023-11-13 04:55:55,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMinorCompactionWithMonthlyPolicy__i1omodofslrc6k4ou0b17ta09s9j2a2cqeg72vhl4ok9hvnd529gfkpoplti0meo/family1/6fc68a5873f342b2a5dae6ecd6d11841 2023-11-13 04:55:55,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-13 04:55:55,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-13 04:55:55,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(1912): d39756ba701219092d4f35836804d315/family1 is initiating minor compaction 2023-11-13 04:55:55,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@61540443; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-13 04:55:55,495 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of d39756ba701219092d4f35836804d315/family1 in testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315. 2023-11-13 04:55:55,495 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/3fa695bc2af34a0ab4f97993b9770d0a, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/b7d37ad4e8ae44369c6476e5b54c025e, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/13ab6cd9576c403b91ccaaa1f382a132, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/3bdca9df59bd4b298ac0c811086e5bdf, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/a0bd7ccde8494e29a587f83431c54f71, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/67ce03a3091f41ceaa093d95d564483e, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/00a35336eb244f8e8d0b1f96f7c622e4, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/384782d4d5f0416ba5c8270467c284eb, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/1e481145bc4a47b5a27ec169648debc5, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/b39786a27c754a3d8eeb4155ce5ece12_SeqId_44_] into tmpdir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/.tmp, totalSize=49.7 K 2023-11-13 04:55:55,495 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 3fa695bc2af34a0ab4f97993b9770d0a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-13 04:55:55,495 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting b7d37ad4e8ae44369c6476e5b54c025e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-13 04:55:55,495 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 13ab6cd9576c403b91ccaaa1f382a132, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-13 04:55:55,495 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 3bdca9df59bd4b298ac0c811086e5bdf, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-13 04:55:55,495 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting a0bd7ccde8494e29a587f83431c54f71, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-13 04:55:55,495 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 67ce03a3091f41ceaa093d95d564483e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-13 04:55:55,495 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 00a35336eb244f8e8d0b1f96f7c622e4, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-13 04:55:55,495 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 384782d4d5f0416ba5c8270467c284eb, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-13 04:55:55,495 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 1e481145bc4a47b5a27ec169648debc5, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-13 04:55:55,495 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting b39786a27c754a3d8eeb4155ce5ece12_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-13 04:55:55,496 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-13 04:55:55,497 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:55:55,498 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010172b103e1438a444394e95c57f1bc8d4b to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010172b103e1438a444394e95c57f1bc8d4b 2023-11-13 04:55:55,499 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601031a358d95d22444b8836587c0a0ac2fe8 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601031a358d95d22444b8836587c0a0ac2fe8 2023-11-13 04:55:55,499 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-11-13 04:55:55,499 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-11-13 04:55:55,500 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-13 04:55:55,500 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-13 04:55:55,548 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] throttle.PressureAwareThroughputController(145): d39756ba701219092d4f35836804d315#family1#compaction#165 average throughput is 0.46 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-13 04:55:55,572 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512319a6f34d712c94bc694faceb79dd9a9e6 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512319a6f34d712c94bc694faceb79dd9a9e6 2023-11-13 04:55:55,573 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-13 04:55:55,595 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/12eeba9fa45c477aa82db65f28f01602 first=Optional[r1] last=Optional[r4] 2023-11-13 04:55:55,595 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315., hostname=jenkins-hbase4.apache.org,41657,1699851201532, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/12eeba9fa45c477aa82db65f28f01602}] 2023-11-13 04:55:55,597 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(763): Validating hfile at hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/12eeba9fa45c477aa82db65f28f01602 for inclusion in d39756ba701219092d4f35836804d315/family1 2023-11-13 04:55:55,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-11-13 04:55:55,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(777): Region bounds: first= last= 2023-11-13 04:55:55,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HRegion(2446): Flush status journal for d39756ba701219092d4f35836804d315: 2023-11-13 04:55:55,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/12eeba9fa45c477aa82db65f28f01602 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMinorCompactionWithMonthlyPolicy__evrjea5fcg5psajh8qfil7dd9j4alsdrv8v0cf3q7r1cig3ubjotem3c7e64cu4v/family1/12eeba9fa45c477aa82db65f28f01602 2023-11-13 04:55:55,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMinorCompactionWithMonthlyPolicy__evrjea5fcg5psajh8qfil7dd9j4alsdrv8v0cf3q7r1cig3ubjotem3c7e64cu4v/family1/12eeba9fa45c477aa82db65f28f01602 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/9666576fe80c48e89e8cd2ff60de2cdf_SeqId_46_ 2023-11-13 04:55:55,602 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(849): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMinorCompactionWithMonthlyPolicy__evrjea5fcg5psajh8qfil7dd9j4alsdrv8v0cf3q7r1cig3ubjotem3c7e64cu4v/family1/12eeba9fa45c477aa82db65f28f01602 into d39756ba701219092d4f35836804d315/family1 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/9666576fe80c48e89e8cd2ff60de2cdf_SeqId_46_ - updating store file list. 2023-11-13 04:55:55,604 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(882): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/9666576fe80c48e89e8cd2ff60de2cdf_SeqId_46_ into d39756ba701219092d4f35836804d315/family1 2023-11-13 04:55:55,604 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(855): Successfully loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMinorCompactionWithMonthlyPolicy__evrjea5fcg5psajh8qfil7dd9j4alsdrv8v0cf3q7r1cig3ubjotem3c7e64cu4v/family1/12eeba9fa45c477aa82db65f28f01602 into d39756ba701219092d4f35836804d315/family1 (new location: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/9666576fe80c48e89e8cd2ff60de2cdf_SeqId_46_) 2023-11-13 04:55:55,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMinorCompactionWithMonthlyPolicy__evrjea5fcg5psajh8qfil7dd9j4alsdrv8v0cf3q7r1cig3ubjotem3c7e64cu4v/family1/12eeba9fa45c477aa82db65f28f01602 2023-11-13 04:55:55,606 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-13 04:55:55,607 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:55:55,608 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201e1815b3b4d3a4885ae17978e3634f6e0 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201e1815b3b4d3a4885ae17978e3634f6e0 2023-11-13 04:55:55,608 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205ca7962ec274a43e7a7736d18544cf2d0 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205ca7962ec274a43e7a7736d18544cf2d0 2023-11-13 04:55:55,609 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228b2f9e6ef2997451c9e7017bfcbb8faf5 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228b2f9e6ef2997451c9e7017bfcbb8faf5 2023-11-13 04:55:55,610 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231095c9084739a4f2c90af9490f51fe6ea to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231095c9084739a4f2c90af9490f51fe6ea 2023-11-13 04:55:55,610 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-11-13 04:55:55,610 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-11-13 04:55:55,610 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-13 04:55:55,610 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-13 04:55:55,972 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/.tmp/family1/c1abd8058c7e44cdad19e80ad096ca43 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/c1abd8058c7e44cdad19e80ad096ca43 2023-11-13 04:55:55,976 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in d39756ba701219092d4f35836804d315/family1 of d39756ba701219092d4f35836804d315 into c1abd8058c7e44cdad19e80ad096ca43(size=6.6 K), total size for store is 178.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-13 04:55:55,976 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for d39756ba701219092d4f35836804d315: 2023-11-13 04:55:55,976 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1699851355494; duration=0sec 2023-11-13 04:55:55,976 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-13 04:55:56,015 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/3fa695bc2af34a0ab4f97993b9770d0a, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/b7d37ad4e8ae44369c6476e5b54c025e, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/13ab6cd9576c403b91ccaaa1f382a132, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/3bdca9df59bd4b298ac0c811086e5bdf, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/a0bd7ccde8494e29a587f83431c54f71, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/67ce03a3091f41ceaa093d95d564483e, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/00a35336eb244f8e8d0b1f96f7c622e4, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/384782d4d5f0416ba5c8270467c284eb, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/1e481145bc4a47b5a27ec169648debc5, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/b39786a27c754a3d8eeb4155ce5ece12_SeqId_44_] to archive 2023-11-13 04:55:56,016 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:55:56,017 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/3fa695bc2af34a0ab4f97993b9770d0a to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/3fa695bc2af34a0ab4f97993b9770d0a 2023-11-13 04:55:56,018 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/b7d37ad4e8ae44369c6476e5b54c025e to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/b7d37ad4e8ae44369c6476e5b54c025e 2023-11-13 04:55:56,019 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/13ab6cd9576c403b91ccaaa1f382a132 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/13ab6cd9576c403b91ccaaa1f382a132 2023-11-13 04:55:56,020 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/3bdca9df59bd4b298ac0c811086e5bdf to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/3bdca9df59bd4b298ac0c811086e5bdf 2023-11-13 04:55:56,021 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/a0bd7ccde8494e29a587f83431c54f71 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/a0bd7ccde8494e29a587f83431c54f71 2023-11-13 04:55:56,022 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/67ce03a3091f41ceaa093d95d564483e to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/67ce03a3091f41ceaa093d95d564483e 2023-11-13 04:55:56,023 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/00a35336eb244f8e8d0b1f96f7c622e4 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/00a35336eb244f8e8d0b1f96f7c622e4 2023-11-13 04:55:56,024 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/384782d4d5f0416ba5c8270467c284eb to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/384782d4d5f0416ba5c8270467c284eb 2023-11-13 04:55:56,025 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/1e481145bc4a47b5a27ec169648debc5 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/1e481145bc4a47b5a27ec169648debc5 2023-11-13 04:55:56,026 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/b39786a27c754a3d8eeb4155ce5ece12_SeqId_44_ to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/b39786a27c754a3d8eeb4155ce5ece12_SeqId_44_ 2023-11-13 04:55:56,440 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130631c37f67321468c88271ae60ba31808 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130631c37f67321468c88271ae60ba31808 2023-11-13 04:55:56,441 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-13 04:55:56,463 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d05ad4f2a4d24ec088f9e5542f43862e first=Optional[r00] last=Optional[r8] 2023-11-13 04:55:56,464 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315., hostname=jenkins-hbase4.apache.org,41657,1699851201532, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d05ad4f2a4d24ec088f9e5542f43862e}] 2023-11-13 04:55:56,466 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(763): Validating hfile at hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d05ad4f2a4d24ec088f9e5542f43862e for inclusion in d39756ba701219092d4f35836804d315/family1 2023-11-13 04:55:56,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-11-13 04:55:56,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(777): Region bounds: first= last= 2023-11-13 04:55:56,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HRegion(2446): Flush status journal for d39756ba701219092d4f35836804d315: 2023-11-13 04:55:56,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d05ad4f2a4d24ec088f9e5542f43862e to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMinorCompactionWithMonthlyPolicy__vbhrtp2v5vlq9nolnbtn618isli9aa01iug0ta1cm6asnctbsl28gkjovf2342cg/family1/d05ad4f2a4d24ec088f9e5542f43862e 2023-11-13 04:55:56,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMinorCompactionWithMonthlyPolicy__vbhrtp2v5vlq9nolnbtn618isli9aa01iug0ta1cm6asnctbsl28gkjovf2342cg/family1/d05ad4f2a4d24ec088f9e5542f43862e as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/0b6ef7fa7c9449c5a62d9813a95284f7_SeqId_49_ 2023-11-13 04:55:56,472 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(849): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMinorCompactionWithMonthlyPolicy__vbhrtp2v5vlq9nolnbtn618isli9aa01iug0ta1cm6asnctbsl28gkjovf2342cg/family1/d05ad4f2a4d24ec088f9e5542f43862e into d39756ba701219092d4f35836804d315/family1 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/0b6ef7fa7c9449c5a62d9813a95284f7_SeqId_49_ - updating store file list. 2023-11-13 04:55:56,478 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(882): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/0b6ef7fa7c9449c5a62d9813a95284f7_SeqId_49_ into d39756ba701219092d4f35836804d315/family1 2023-11-13 04:55:56,478 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(855): Successfully loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMinorCompactionWithMonthlyPolicy__vbhrtp2v5vlq9nolnbtn618isli9aa01iug0ta1cm6asnctbsl28gkjovf2342cg/family1/d05ad4f2a4d24ec088f9e5542f43862e into d39756ba701219092d4f35836804d315/family1 (new location: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/0b6ef7fa7c9449c5a62d9813a95284f7_SeqId_49_) 2023-11-13 04:55:56,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMinorCompactionWithMonthlyPolicy__vbhrtp2v5vlq9nolnbtn618isli9aa01iug0ta1cm6asnctbsl28gkjovf2342cg/family1/d05ad4f2a4d24ec088f9e5542f43862e 2023-11-13 04:55:56,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-13 04:55:56,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 352581 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-13 04:55:56,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(1912): d39756ba701219092d4f35836804d315/family1 is initiating minor compaction (all files) 2023-11-13 04:55:56,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4b3479b1; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-13 04:55:56,480 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of d39756ba701219092d4f35836804d315/family1 in testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315. 2023-11-13 04:55:56,480 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/328ae011211a4df2a564738048efcafc, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/c1abd8058c7e44cdad19e80ad096ca43, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/9666576fe80c48e89e8cd2ff60de2cdf_SeqId_46_, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/0b6ef7fa7c9449c5a62d9813a95284f7_SeqId_49_] into tmpdir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/.tmp, totalSize=344.3 K 2023-11-13 04:55:56,480 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 328ae011211a4df2a564738048efcafc, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878824229 2023-11-13 04:55:56,481 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting c1abd8058c7e44cdad19e80ad096ca43, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621224229 2023-11-13 04:55:56,481 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 9666576fe80c48e89e8cd2ff60de2cdf_SeqId_46_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448965224229 2023-11-13 04:55:56,481 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-13 04:55:56,481 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] compactions.Compactor(207): Compacting 0b6ef7fa7c9449c5a62d9813a95284f7_SeqId_49_, keycount=1001, bloomtype=ROW, size=166.2 K, encoding=NONE, compression=NONE, seqNum=50, earliestPutTs=1448014824229 2023-11-13 04:55:56,482 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:55:56,483 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120919c5de5d78249bb811c9b253ac60e36 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120919c5de5d78249bb811c9b253ac60e36 2023-11-13 04:55:56,484 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128758062c41f904c9ea35cf63a817d0b09 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128758062c41f904c9ea35cf63a817d0b09 2023-11-13 04:55:56,485 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130edc5df0d80fb4538a886cc0f23a77433 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130edc5df0d80fb4538a886cc0f23a77433 2023-11-13 04:55:56,485 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-11-13 04:55:56,485 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-13 04:55:56,486 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-13 04:55:56,486 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-13 04:55:56,486 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-13 04:55:56,486 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-13 04:55:56,486 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-13 04:55:56,488 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-13 04:55:56,489 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 1.4760 sec 2023-11-13 04:55:56,499 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] throttle.PressureAwareThroughputController(145): d39756ba701219092d4f35836804d315#family1#compaction#166 average throughput is 19.45 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-13 04:55:56,713 INFO [Listener at localhost/34517] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=262 (was 252) - Thread LEAK? -, OpenFileDescriptor=683 (was 662) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=119 (was 122), ProcessCount=167 (was 167), AvailableMemoryMB=2835 (was 2841) 2023-11-13 04:55:56,728 INFO [Listener at localhost/34517] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=262, OpenFileDescriptor=683, MaxFileDescriptor=60000, SystemLoadAverage=119, ProcessCount=167, AvailableMemoryMB=2835 2023-11-13 04:55:56,753 DEBUG [Listener at localhost/34517] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-11-13 04:55:56,806 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10 -r\xCB(\xED\x06\x14\xB7F\xBD\xBFU\xAAW."\x10\xC3S\x13\xBA\x9C1\x04\x85\x85\xCB~\xA8\x9E:\xFA\x0F*\x10j\xC9=\xE8j\xC3\x9F\x0C\xC8\xF1\xDC\x17\xB1\xAF\x1Fr2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-13 04:55:56,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] procedure2.ProcedureExecutor(1028): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-11-13 04:55:56,809 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-11-13 04:55:56,809 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-11-13 04:55:56,809 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-13 04:55:56,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-13 04:55:56,811 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13 2023-11-13 04:55:56,811 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab 2023-11-13 04:55:56,811 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a 2023-11-13 04:55:56,812 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13 empty. 2023-11-13 04:55:56,812 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab empty. 2023-11-13 04:55:56,812 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a empty. 2023-11-13 04:55:56,812 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13 2023-11-13 04:55:56,812 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab 2023-11-13 04:55:56,812 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a 2023-11-13 04:55:56,812 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-11-13 04:55:56,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-13 04:55:57,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-13 04:55:57,219 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-11-13 04:55:57,220 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7675): creating {ENCODED => 88c06180dda7a041f01d4b128564bf13, NAME => 'testMajorCompactionFromAdmin,,1699851356777.88c06180dda7a041f01d4b128564bf13.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10 -r\xCB(\xED\x06\x14\xB7F\xBD\xBFU\xAAW."\x10\xC3S\x13\xBA\x9C1\x04\x85\x85\xCB~\xA8\x9E:\xFA\x0F*\x10j\xC9=\xE8j\xC3\x9F\x0C\xC8\xF1\xDC\x17\xB1\xAF\x1Fr2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp 2023-11-13 04:55:57,221 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7675): creating {ENCODED => f692c4768bba87d4f27f89747545abab, NAME => 'testMajorCompactionFromAdmin,1,1699851356777.f692c4768bba87d4f27f89747545abab.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10 -r\xCB(\xED\x06\x14\xB7F\xBD\xBFU\xAAW."\x10\xC3S\x13\xBA\x9C1\x04\x85\x85\xCB~\xA8\x9E:\xFA\x0F*\x10j\xC9=\xE8j\xC3\x9F\x0C\xC8\xF1\xDC\x17\xB1\xAF\x1Fr2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp 2023-11-13 04:55:57,221 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7675): creating {ENCODED => 812b4480b089b56a87a7dec53ca31d1a, NAME => 'testMajorCompactionFromAdmin,2,1699851356777.812b4480b089b56a87a7dec53ca31d1a.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10 -r\xCB(\xED\x06\x14\xB7F\xBD\xBFU\xAAW."\x10\xC3S\x13\xBA\x9C1\x04\x85\x85\xCB~\xA8\x9E:\xFA\x0F*\x10j\xC9=\xE8j\xC3\x9F\x0C\xC8\xF1\xDC\x17\xB1\xAF\x1Fr2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/.tmp 2023-11-13 04:55:57,330 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/.tmp/family1/7864842503a640a299122f74c9acd6e4 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/7864842503a640a299122f74c9acd6e4 2023-11-13 04:55:57,334 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in d39756ba701219092d4f35836804d315/family1 of d39756ba701219092d4f35836804d315 into 7864842503a640a299122f74c9acd6e4(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-13 04:55:57,334 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for d39756ba701219092d4f35836804d315: 2023-11-13 04:55:57,334 INFO [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315., storeName=family1, fileCount=4, fileSize=344.3 K (166.0 K, 6.6 K, 5.5 K, 166.2 K), priority=2, time=1699851356479; duration=0sec 2023-11-13 04:55:57,334 DEBUG [RS:0;jenkins-hbase4:41657-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-13 04:55:57,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-13 04:55:57,414 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/328ae011211a4df2a564738048efcafc, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/c1abd8058c7e44cdad19e80ad096ca43, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/9666576fe80c48e89e8cd2ff60de2cdf_SeqId_46_, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/0b6ef7fa7c9449c5a62d9813a95284f7_SeqId_49_] to archive 2023-11-13 04:55:57,415 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:55:57,416 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/328ae011211a4df2a564738048efcafc to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/328ae011211a4df2a564738048efcafc 2023-11-13 04:55:57,417 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/c1abd8058c7e44cdad19e80ad096ca43 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/c1abd8058c7e44cdad19e80ad096ca43 2023-11-13 04:55:57,418 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/9666576fe80c48e89e8cd2ff60de2cdf_SeqId_46_ to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/9666576fe80c48e89e8cd2ff60de2cdf_SeqId_46_ 2023-11-13 04:55:57,419 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/0b6ef7fa7c9449c5a62d9813a95284f7_SeqId_49_ to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/family1/0b6ef7fa7c9449c5a62d9813a95284f7_SeqId_49_ 2023-11-13 04:55:57,642 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1699851356777.f692c4768bba87d4f27f89747545abab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-13 04:55:57,642 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1699851356777.812b4480b089b56a87a7dec53ca31d1a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-13 04:55:57,642 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1699851356777.88c06180dda7a041f01d4b128564bf13.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-13 04:55:57,642 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1604): Closing 812b4480b089b56a87a7dec53ca31d1a, disabling compactions & flushes 2023-11-13 04:55:57,642 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1604): Closing 88c06180dda7a041f01d4b128564bf13, disabling compactions & flushes 2023-11-13 04:55:57,642 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1699851356777.812b4480b089b56a87a7dec53ca31d1a. 2023-11-13 04:55:57,642 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1699851356777.812b4480b089b56a87a7dec53ca31d1a. 2023-11-13 04:55:57,642 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1604): Closing f692c4768bba87d4f27f89747545abab, disabling compactions & flushes 2023-11-13 04:55:57,642 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1699851356777.812b4480b089b56a87a7dec53ca31d1a. after waiting 0 ms 2023-11-13 04:55:57,643 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1699851356777.812b4480b089b56a87a7dec53ca31d1a. 2023-11-13 04:55:57,642 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1699851356777.88c06180dda7a041f01d4b128564bf13. 2023-11-13 04:55:57,643 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1699851356777.812b4480b089b56a87a7dec53ca31d1a. 2023-11-13 04:55:57,643 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1558): Region close journal for 812b4480b089b56a87a7dec53ca31d1a: 2023-11-13 04:55:57,642 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1699851356777.f692c4768bba87d4f27f89747545abab. 2023-11-13 04:55:57,643 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1699851356777.88c06180dda7a041f01d4b128564bf13. 2023-11-13 04:55:57,643 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1699851356777.f692c4768bba87d4f27f89747545abab. 2023-11-13 04:55:57,643 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1699851356777.88c06180dda7a041f01d4b128564bf13. after waiting 0 ms 2023-11-13 04:55:57,643 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1699851356777.88c06180dda7a041f01d4b128564bf13. 2023-11-13 04:55:57,643 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1699851356777.f692c4768bba87d4f27f89747545abab. after waiting 0 ms 2023-11-13 04:55:57,643 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1699851356777.88c06180dda7a041f01d4b128564bf13. 2023-11-13 04:55:57,643 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1558): Region close journal for 88c06180dda7a041f01d4b128564bf13: 2023-11-13 04:55:57,643 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1699851356777.f692c4768bba87d4f27f89747545abab. 2023-11-13 04:55:57,643 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1699851356777.f692c4768bba87d4f27f89747545abab. 2023-11-13 04:55:57,643 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1558): Region close journal for f692c4768bba87d4f27f89747545abab: 2023-11-13 04:55:57,645 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-11-13 04:55:57,646 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1699851356777.812b4480b089b56a87a7dec53ca31d1a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699851357646"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699851357646"}]},"ts":"1699851357646"} 2023-11-13 04:55:57,646 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1699851356777.88c06180dda7a041f01d4b128564bf13.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699851357646"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699851357646"}]},"ts":"1699851357646"} 2023-11-13 04:55:57,646 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1699851356777.f692c4768bba87d4f27f89747545abab.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1699851357646"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699851357646"}]},"ts":"1699851357646"} 2023-11-13 04:55:57,648 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-13 04:55:57,648 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-13 04:55:57,648 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699851357648"}]},"ts":"1699851357648"} 2023-11-13 04:55:57,649 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-11-13 04:55:57,653 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=88c06180dda7a041f01d4b128564bf13, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=f692c4768bba87d4f27f89747545abab, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=812b4480b089b56a87a7dec53ca31d1a, ASSIGN}] 2023-11-13 04:55:57,655 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=88c06180dda7a041f01d4b128564bf13, ASSIGN 2023-11-13 04:55:57,655 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=f692c4768bba87d4f27f89747545abab, ASSIGN 2023-11-13 04:55:57,655 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=812b4480b089b56a87a7dec53ca31d1a, ASSIGN 2023-11-13 04:55:57,655 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=88c06180dda7a041f01d4b128564bf13, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41657,1699851201532; forceNewPlan=false, retain=false 2023-11-13 04:55:57,655 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=812b4480b089b56a87a7dec53ca31d1a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41657,1699851201532; forceNewPlan=false, retain=false 2023-11-13 04:55:57,655 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=f692c4768bba87d4f27f89747545abab, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41657,1699851201532; forceNewPlan=false, retain=false 2023-11-13 04:55:57,807 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=f692c4768bba87d4f27f89747545abab, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:57,807 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=88c06180dda7a041f01d4b128564bf13, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:57,807 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=812b4480b089b56a87a7dec53ca31d1a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:57,807 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1699851356777.88c06180dda7a041f01d4b128564bf13.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699851357807"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699851357807"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699851357807"}]},"ts":"1699851357807"} 2023-11-13 04:55:57,807 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1699851356777.f692c4768bba87d4f27f89747545abab.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1699851357807"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699851357807"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699851357807"}]},"ts":"1699851357807"} 2023-11-13 04:55:57,807 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1699851356777.812b4480b089b56a87a7dec53ca31d1a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699851357807"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699851357807"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699851357807"}]},"ts":"1699851357807"} 2023-11-13 04:55:57,809 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=120, ppid=117, state=RUNNABLE; OpenRegionProcedure 88c06180dda7a041f01d4b128564bf13, server=jenkins-hbase4.apache.org,41657,1699851201532}] 2023-11-13 04:55:57,809 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=121, ppid=118, state=RUNNABLE; OpenRegionProcedure f692c4768bba87d4f27f89747545abab, server=jenkins-hbase4.apache.org,41657,1699851201532}] 2023-11-13 04:55:57,810 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=122, ppid=119, state=RUNNABLE; OpenRegionProcedure 812b4480b089b56a87a7dec53ca31d1a, server=jenkins-hbase4.apache.org,41657,1699851201532}] 2023-11-13 04:55:57,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-13 04:55:57,960 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:57,963 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,2,1699851356777.812b4480b089b56a87a7dec53ca31d1a. 2023-11-13 04:55:57,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 812b4480b089b56a87a7dec53ca31d1a, NAME => 'testMajorCompactionFromAdmin,2,1699851356777.812b4480b089b56a87a7dec53ca31d1a.', STARTKEY => '2', ENDKEY => ''} 2023-11-13 04:55:57,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 812b4480b089b56a87a7dec53ca31d1a 2023-11-13 04:55:57,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1699851356777.812b4480b089b56a87a7dec53ca31d1a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-13 04:55:57,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 812b4480b089b56a87a7dec53ca31d1a 2023-11-13 04:55:57,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 812b4480b089b56a87a7dec53ca31d1a 2023-11-13 04:55:57,984 INFO [StoreOpener-812b4480b089b56a87a7dec53ca31d1a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 812b4480b089b56a87a7dec53ca31d1a 2023-11-13 04:55:57,985 DEBUG [StoreOpener-812b4480b089b56a87a7dec53ca31d1a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family1 2023-11-13 04:55:57,986 DEBUG [StoreOpener-812b4480b089b56a87a7dec53ca31d1a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family1 2023-11-13 04:55:57,986 INFO [StoreOpener-812b4480b089b56a87a7dec53ca31d1a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 812b4480b089b56a87a7dec53ca31d1a columnFamilyName family1 2023-11-13 04:55:57,987 INFO [StoreOpener-812b4480b089b56a87a7dec53ca31d1a-1] regionserver.HStore(310): Store=812b4480b089b56a87a7dec53ca31d1a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-13 04:55:57,987 INFO [StoreOpener-812b4480b089b56a87a7dec53ca31d1a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 812b4480b089b56a87a7dec53ca31d1a 2023-11-13 04:55:57,988 DEBUG [StoreOpener-812b4480b089b56a87a7dec53ca31d1a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family2 2023-11-13 04:55:57,988 DEBUG [StoreOpener-812b4480b089b56a87a7dec53ca31d1a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family2 2023-11-13 04:55:57,988 INFO [StoreOpener-812b4480b089b56a87a7dec53ca31d1a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 812b4480b089b56a87a7dec53ca31d1a columnFamilyName family2 2023-11-13 04:55:57,989 INFO [StoreOpener-812b4480b089b56a87a7dec53ca31d1a-1] regionserver.HStore(310): Store=812b4480b089b56a87a7dec53ca31d1a/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-13 04:55:57,990 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a 2023-11-13 04:55:57,990 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a 2023-11-13 04:55:57,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-13 04:55:57,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 812b4480b089b56a87a7dec53ca31d1a 2023-11-13 04:55:57,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-13 04:55:57,994 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 812b4480b089b56a87a7dec53ca31d1a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72170425, jitterRate=0.07542313635349274}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-13 04:55:57,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 812b4480b089b56a87a7dec53ca31d1a: 2023-11-13 04:55:57,995 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,2,1699851356777.812b4480b089b56a87a7dec53ca31d1a., pid=122, masterSystemTime=1699851357960 2023-11-13 04:55:57,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,2,1699851356777.812b4480b089b56a87a7dec53ca31d1a. 2023-11-13 04:55:57,996 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,2,1699851356777.812b4480b089b56a87a7dec53ca31d1a. 2023-11-13 04:55:57,996 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,,1699851356777.88c06180dda7a041f01d4b128564bf13. 2023-11-13 04:55:57,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 88c06180dda7a041f01d4b128564bf13, NAME => 'testMajorCompactionFromAdmin,,1699851356777.88c06180dda7a041f01d4b128564bf13.', STARTKEY => '', ENDKEY => '1'} 2023-11-13 04:55:57,996 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=812b4480b089b56a87a7dec53ca31d1a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:57,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 88c06180dda7a041f01d4b128564bf13 2023-11-13 04:55:57,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1699851356777.88c06180dda7a041f01d4b128564bf13.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-13 04:55:57,997 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1699851356777.812b4480b089b56a87a7dec53ca31d1a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699851357996"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699851357996"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699851357996"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699851357996"}]},"ts":"1699851357996"} 2023-11-13 04:55:57,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 88c06180dda7a041f01d4b128564bf13 2023-11-13 04:55:57,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 88c06180dda7a041f01d4b128564bf13 2023-11-13 04:55:57,999 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=122, resume processing ppid=119 2023-11-13 04:55:57,999 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=122, ppid=119, state=SUCCESS; OpenRegionProcedure 812b4480b089b56a87a7dec53ca31d1a, server=jenkins-hbase4.apache.org,41657,1699851201532 in 188 msec 2023-11-13 04:55:58,000 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=812b4480b089b56a87a7dec53ca31d1a, ASSIGN in 346 msec 2023-11-13 04:55:58,017 INFO [StoreOpener-88c06180dda7a041f01d4b128564bf13-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 88c06180dda7a041f01d4b128564bf13 2023-11-13 04:55:58,018 DEBUG [StoreOpener-88c06180dda7a041f01d4b128564bf13-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family1 2023-11-13 04:55:58,018 DEBUG [StoreOpener-88c06180dda7a041f01d4b128564bf13-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family1 2023-11-13 04:55:58,018 INFO [StoreOpener-88c06180dda7a041f01d4b128564bf13-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 88c06180dda7a041f01d4b128564bf13 columnFamilyName family1 2023-11-13 04:55:58,019 INFO [StoreOpener-88c06180dda7a041f01d4b128564bf13-1] regionserver.HStore(310): Store=88c06180dda7a041f01d4b128564bf13/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-13 04:55:58,019 INFO [StoreOpener-88c06180dda7a041f01d4b128564bf13-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 88c06180dda7a041f01d4b128564bf13 2023-11-13 04:55:58,020 DEBUG [StoreOpener-88c06180dda7a041f01d4b128564bf13-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family2 2023-11-13 04:55:58,020 DEBUG [StoreOpener-88c06180dda7a041f01d4b128564bf13-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family2 2023-11-13 04:55:58,020 INFO [StoreOpener-88c06180dda7a041f01d4b128564bf13-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 88c06180dda7a041f01d4b128564bf13 columnFamilyName family2 2023-11-13 04:55:58,021 INFO [StoreOpener-88c06180dda7a041f01d4b128564bf13-1] regionserver.HStore(310): Store=88c06180dda7a041f01d4b128564bf13/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-13 04:55:58,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13 2023-11-13 04:55:58,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13 2023-11-13 04:55:58,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-13 04:55:58,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 88c06180dda7a041f01d4b128564bf13 2023-11-13 04:55:58,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-13 04:55:58,025 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 88c06180dda7a041f01d4b128564bf13; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60802328, jitterRate=-0.09397470951080322}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-13 04:55:58,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 88c06180dda7a041f01d4b128564bf13: 2023-11-13 04:55:58,026 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,,1699851356777.88c06180dda7a041f01d4b128564bf13., pid=120, masterSystemTime=1699851357960 2023-11-13 04:55:58,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,,1699851356777.88c06180dda7a041f01d4b128564bf13. 2023-11-13 04:55:58,027 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,,1699851356777.88c06180dda7a041f01d4b128564bf13. 2023-11-13 04:55:58,027 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,1,1699851356777.f692c4768bba87d4f27f89747545abab. 2023-11-13 04:55:58,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f692c4768bba87d4f27f89747545abab, NAME => 'testMajorCompactionFromAdmin,1,1699851356777.f692c4768bba87d4f27f89747545abab.', STARTKEY => '1', ENDKEY => '2'} 2023-11-13 04:55:58,027 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=88c06180dda7a041f01d4b128564bf13, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:58,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin f692c4768bba87d4f27f89747545abab 2023-11-13 04:55:58,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1699851356777.f692c4768bba87d4f27f89747545abab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-13 04:55:58,027 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1699851356777.88c06180dda7a041f01d4b128564bf13.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699851358027"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699851358027"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699851358027"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699851358027"}]},"ts":"1699851358027"} 2023-11-13 04:55:58,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f692c4768bba87d4f27f89747545abab 2023-11-13 04:55:58,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f692c4768bba87d4f27f89747545abab 2023-11-13 04:55:58,030 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=120, resume processing ppid=117 2023-11-13 04:55:58,030 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=120, ppid=117, state=SUCCESS; OpenRegionProcedure 88c06180dda7a041f01d4b128564bf13, server=jenkins-hbase4.apache.org,41657,1699851201532 in 219 msec 2023-11-13 04:55:58,030 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=88c06180dda7a041f01d4b128564bf13, ASSIGN in 377 msec 2023-11-13 04:55:58,048 INFO [StoreOpener-f692c4768bba87d4f27f89747545abab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f692c4768bba87d4f27f89747545abab 2023-11-13 04:55:58,049 DEBUG [StoreOpener-f692c4768bba87d4f27f89747545abab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family1 2023-11-13 04:55:58,049 DEBUG [StoreOpener-f692c4768bba87d4f27f89747545abab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family1 2023-11-13 04:55:58,049 INFO [StoreOpener-f692c4768bba87d4f27f89747545abab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f692c4768bba87d4f27f89747545abab columnFamilyName family1 2023-11-13 04:55:58,050 INFO [StoreOpener-f692c4768bba87d4f27f89747545abab-1] regionserver.HStore(310): Store=f692c4768bba87d4f27f89747545abab/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-13 04:55:58,050 INFO [StoreOpener-f692c4768bba87d4f27f89747545abab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region f692c4768bba87d4f27f89747545abab 2023-11-13 04:55:58,051 DEBUG [StoreOpener-f692c4768bba87d4f27f89747545abab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family2 2023-11-13 04:55:58,051 DEBUG [StoreOpener-f692c4768bba87d4f27f89747545abab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family2 2023-11-13 04:55:58,051 INFO [StoreOpener-f692c4768bba87d4f27f89747545abab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f692c4768bba87d4f27f89747545abab columnFamilyName family2 2023-11-13 04:55:58,052 INFO [StoreOpener-f692c4768bba87d4f27f89747545abab-1] regionserver.HStore(310): Store=f692c4768bba87d4f27f89747545abab/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-13 04:55:58,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab 2023-11-13 04:55:58,053 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab 2023-11-13 04:55:58,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-13 04:55:58,055 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f692c4768bba87d4f27f89747545abab 2023-11-13 04:55:58,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-13 04:55:58,056 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f692c4768bba87d4f27f89747545abab; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65480339, jitterRate=-0.024266913533210754}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-13 04:55:58,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f692c4768bba87d4f27f89747545abab: 2023-11-13 04:55:58,057 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,1,1699851356777.f692c4768bba87d4f27f89747545abab., pid=121, masterSystemTime=1699851357960 2023-11-13 04:55:58,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,1,1699851356777.f692c4768bba87d4f27f89747545abab. 2023-11-13 04:55:58,058 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,1,1699851356777.f692c4768bba87d4f27f89747545abab. 2023-11-13 04:55:58,058 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=f692c4768bba87d4f27f89747545abab, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:58,059 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1699851356777.f692c4768bba87d4f27f89747545abab.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1699851358058"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699851358058"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699851358058"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699851358058"}]},"ts":"1699851358058"} 2023-11-13 04:55:58,060 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=121, resume processing ppid=118 2023-11-13 04:55:58,061 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=121, ppid=118, state=SUCCESS; OpenRegionProcedure f692c4768bba87d4f27f89747545abab, server=jenkins-hbase4.apache.org,41657,1699851201532 in 250 msec 2023-11-13 04:55:58,062 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-11-13 04:55:58,062 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=f692c4768bba87d4f27f89747545abab, ASSIGN in 408 msec 2023-11-13 04:55:58,062 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-13 04:55:58,062 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699851358062"}]},"ts":"1699851358062"} 2023-11-13 04:55:58,063 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-11-13 04:55:58,065 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-11-13 04:55:58,066 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 1.2590 sec 2023-11-13 04:55:58,864 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-11-13 04:55:58,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-13 04:55:58,915 INFO [Listener at localhost/34517] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-11-13 04:55:58,920 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1699851356777.88c06180dda7a041f01d4b128564bf13. with WAL disabled. Data may be lost in the event of a crash. 2023-11-13 04:55:58,921 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1699851356777.f692c4768bba87d4f27f89747545abab. with WAL disabled. Data may be lost in the event of a crash. 2023-11-13 04:55:58,921 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1699851356777.812b4480b089b56a87a7dec53ca31d1a. with WAL disabled. Data may be lost in the event of a crash. 2023-11-13 04:55:58,923 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:55:58,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-13 04:55:58,924 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-13 04:55:58,924 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:55:58,924 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-13 04:55:58,924 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-13 04:55:58,925 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-13 04:55:58,925 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-13 04:55:58,926 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:58,926 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:55:58,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:55:58,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:55:58,926 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:58,926 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:55:58,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-13 04:55:58,927 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-13 04:55:58,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:55:58,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-13 04:55:58,927 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-13 04:55:58,927 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-13 04:55:58,927 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-13 04:55:58,927 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:55:58,927 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-13 04:55:58,928 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1699851356777.88c06180dda7a041f01d4b128564bf13. 2023-11-13 04:55:58,928 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1699851356777.88c06180dda7a041f01d4b128564bf13. started... 2023-11-13 04:55:58,928 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-13 04:55:58,928 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:55:58,928 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1699851356777.f692c4768bba87d4f27f89747545abab. 2023-11-13 04:55:58,928 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1699851356777.812b4480b089b56a87a7dec53ca31d1a. 2023-11-13 04:55:58,929 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1699851356777.812b4480b089b56a87a7dec53ca31d1a. started... 2023-11-13 04:55:58,929 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1699851356777.f692c4768bba87d4f27f89747545abab. started... 2023-11-13 04:55:58,928 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 88c06180dda7a041f01d4b128564bf13 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-13 04:55:58,929 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 812b4480b089b56a87a7dec53ca31d1a 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-13 04:55:58,929 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing f692c4768bba87d4f27f89747545abab 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-13 04:55:58,976 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311132907a89ebc9c4ed886090ad4f5872224 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311132907a89ebc9c4ed886090ad4f5872224 2023-11-13 04:55:58,980 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111386f826c83e1044369399fec3ecc19ebb to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023111386f826c83e1044369399fec3ecc19ebb 2023-11-13 04:55:58,990 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/.tmp/family1/f7cc1b10ff75432c94923a45eb2910d7 2023-11-13 04:55:58,993 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/.tmp/family1/55133de0a60e4e2db0dd8e2e33b003b4 2023-11-13 04:55:59,031 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231113d1011d54cb4d4d339ed54a9c474487ef to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20231113d1011d54cb4d4d339ed54a9c474487ef 2023-11-13 04:55:59,035 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/.tmp/family2/83e1da595baa4a9db251d9e8c33904eb 2023-11-13 04:55:59,038 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/.tmp/family1/f7cc1b10ff75432c94923a45eb2910d7 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family1/f7cc1b10ff75432c94923a45eb2910d7 2023-11-13 04:55:59,061 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family1/f7cc1b10ff75432c94923a45eb2910d7, entries=4, sequenceid=5, filesize=5.5 K 2023-11-13 04:55:59,061 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/.tmp/family2/83e1da595baa4a9db251d9e8c33904eb as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family2/83e1da595baa4a9db251d9e8c33904eb 2023-11-13 04:55:59,064 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family2/83e1da595baa4a9db251d9e8c33904eb, entries=2, sequenceid=5, filesize=5.1 K 2023-11-13 04:55:59,065 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for f692c4768bba87d4f27f89747545abab in 136ms, sequenceid=5, compaction requested=false 2023-11-13 04:55:59,066 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for f692c4768bba87d4f27f89747545abab: 2023-11-13 04:55:59,066 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1699851356777.f692c4768bba87d4f27f89747545abab. 2023-11-13 04:55:59,066 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-13 04:55:59,382 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111347d66fefa9b941cf939b94f2e82fbf19 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023111347d66fefa9b941cf939b94f2e82fbf19 2023-11-13 04:55:59,396 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/.tmp/family1/49c3e851b47f4fbcbfbf7f07fdd6e2b2 2023-11-13 04:55:59,424 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231113636e4c1b2cb34c5da057c7f909ce9149 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231113636e4c1b2cb34c5da057c7f909ce9149 2023-11-13 04:55:59,427 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311139cb991d0c1bd4204b6e2b938fce946f1 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202311139cb991d0c1bd4204b6e2b938fce946f1 2023-11-13 04:55:59,429 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/.tmp/family2/244851e6d2774c18a1356557bf305e40 2023-11-13 04:55:59,431 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/.tmp/family2/b114e07e4a5f4a298779a115a86e2ffd 2023-11-13 04:55:59,433 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/.tmp/family1/55133de0a60e4e2db0dd8e2e33b003b4 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family1/55133de0a60e4e2db0dd8e2e33b003b4 2023-11-13 04:55:59,435 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/.tmp/family1/49c3e851b47f4fbcbfbf7f07fdd6e2b2 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family1/49c3e851b47f4fbcbfbf7f07fdd6e2b2 2023-11-13 04:55:59,456 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family1/55133de0a60e4e2db0dd8e2e33b003b4, entries=4, sequenceid=5, filesize=5.5 K 2023-11-13 04:55:59,456 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family1/49c3e851b47f4fbcbfbf7f07fdd6e2b2, entries=4, sequenceid=5, filesize=5.5 K 2023-11-13 04:55:59,456 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/.tmp/family2/244851e6d2774c18a1356557bf305e40 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family2/244851e6d2774c18a1356557bf305e40 2023-11-13 04:55:59,457 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/.tmp/family2/b114e07e4a5f4a298779a115a86e2ffd as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family2/b114e07e4a5f4a298779a115a86e2ffd 2023-11-13 04:55:59,461 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family2/b114e07e4a5f4a298779a115a86e2ffd, entries=2, sequenceid=5, filesize=5.1 K 2023-11-13 04:55:59,461 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family2/244851e6d2774c18a1356557bf305e40, entries=2, sequenceid=5, filesize=5.1 K 2023-11-13 04:55:59,461 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 88c06180dda7a041f01d4b128564bf13 in 533ms, sequenceid=5, compaction requested=false 2023-11-13 04:55:59,461 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 88c06180dda7a041f01d4b128564bf13: 2023-11-13 04:55:59,461 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1699851356777.88c06180dda7a041f01d4b128564bf13. 2023-11-13 04:55:59,462 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-13 04:55:59,462 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 812b4480b089b56a87a7dec53ca31d1a in 533ms, sequenceid=5, compaction requested=false 2023-11-13 04:55:59,462 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 812b4480b089b56a87a7dec53ca31d1a: 2023-11-13 04:55:59,462 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1699851356777.812b4480b089b56a87a7dec53ca31d1a. 2023-11-13 04:55:59,462 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-13 04:55:59,462 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-13 04:55:59,462 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:59,462 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-13 04:55:59,462 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-13 04:55:59,464 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:59,464 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-13 04:55:59,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:59,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:59,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:59,465 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-13 04:55:59,465 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:55:59,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:59,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:59,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-13 04:55:59,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:59,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:59,466 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-13 04:55:59,466 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@499851a4[Count = 0] remaining members to acquire global barrier 2023-11-13 04:55:59,466 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-13 04:55:59,467 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-13 04:55:59,468 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-13 04:55:59,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-13 04:55:59,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-13 04:55:59,468 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-13 04:55:59,468 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-13 04:55:59,468 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:55:59,468 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:59,468 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:55:59,469 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-13 04:55:59,470 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:55:59,469 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:59,470 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-13 04:55:59,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:59,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:59,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:59,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:59,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:59,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-13 04:55:59,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:59,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:59,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-13 04:55:59,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:59,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:55:59,472 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-13 04:55:59,472 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-13 04:55:59,472 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:55:59,472 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:55:59,472 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-13 04:55:59,472 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:55:59,477 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-13 04:55:59,477 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-13 04:55:59,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-13 04:55:59,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-13 04:55:59,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:55:59,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:55:59,477 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:55:59,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-13 04:55:59,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:55:59,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:55:59,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:55:59,478 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:59,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-13 04:55:59,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-13 04:55:59,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:55:59,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-13 04:55:59,479 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:59,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:59,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:55:59,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-13 04:55:59,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:59,481 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:59,481 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-13 04:55:59,481 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-13 04:55:59,481 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:59,481 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-13 04:55:59,481 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-13 04:55:59,481 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-13 04:55:59,481 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:55:59,481 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-13 04:55:59,482 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:55:59,481 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:55:59,482 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-13 04:55:59,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:55:59,481 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:55:59,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:55:59,482 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-13 04:55:59,482 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:55:59,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:55:59,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:55:59,582 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:55:59,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:55:59,584 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1699851356777.88c06180dda7a041f01d4b128564bf13. with WAL disabled. Data may be lost in the event of a crash. 2023-11-13 04:55:59,584 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1699851356777.f692c4768bba87d4f27f89747545abab. with WAL disabled. Data may be lost in the event of a crash. 2023-11-13 04:55:59,584 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1699851356777.812b4480b089b56a87a7dec53ca31d1a. with WAL disabled. Data may be lost in the event of a crash. 2023-11-13 04:55:59,587 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:55:59,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-13 04:55:59,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-13 04:55:59,589 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-13 04:55:59,589 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:55:59,589 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-13 04:55:59,589 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-13 04:55:59,589 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-13 04:55:59,589 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-13 04:55:59,591 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:59,591 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:55:59,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:55:59,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:55:59,591 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:55:59,591 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:55:59,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-13 04:55:59,592 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-13 04:55:59,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:55:59,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-13 04:55:59,592 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-13 04:55:59,592 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-13 04:55:59,592 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-13 04:55:59,592 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-13 04:55:59,592 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:55:59,592 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-13 04:55:59,593 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1699851356777.88c06180dda7a041f01d4b128564bf13. 2023-11-13 04:55:59,593 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-13 04:55:59,593 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:55:59,593 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1699851356777.f692c4768bba87d4f27f89747545abab. 2023-11-13 04:55:59,593 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1699851356777.88c06180dda7a041f01d4b128564bf13. started... 2023-11-13 04:55:59,593 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1699851356777.f692c4768bba87d4f27f89747545abab. started... 2023-11-13 04:55:59,593 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1699851356777.812b4480b089b56a87a7dec53ca31d1a. 2023-11-13 04:55:59,593 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing f692c4768bba87d4f27f89747545abab 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-13 04:55:59,593 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1699851356777.812b4480b089b56a87a7dec53ca31d1a. started... 2023-11-13 04:55:59,593 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 88c06180dda7a041f01d4b128564bf13 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-13 04:55:59,593 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 812b4480b089b56a87a7dec53ca31d1a 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-13 04:55:59,653 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311134e4b7465eef84cb0a3814a75ffba0223 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311134e4b7465eef84cb0a3814a75ffba0223 2023-11-13 04:56:00,044 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231113f48b4960e19442e88503d31c86030503 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231113f48b4960e19442e88503d31c86030503 2023-11-13 04:56:00,052 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311130a6df6c573d24b83b115742d46db49ea to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311130a6df6c573d24b83b115742d46db49ea 2023-11-13 04:56:00,067 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/.tmp/family1/5360c3c2d8f748e2a5a743ee0aaff9d5 2023-11-13 04:56:00,067 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/.tmp/family1/fa7f3d3fa4ab48ce896cf397b9ed0352 2023-11-13 04:56:00,107 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311131385718ff8d243ce841a78a955bd3fff to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202311131385718ff8d243ce841a78a955bd3fff 2023-11-13 04:56:00,459 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/.tmp/family1/34b1558e458747b48b3844048308dede 2023-11-13 04:56:00,516 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/.tmp/family2/2fa0dadcd098488b851609066c401e9f 2023-11-13 04:56:00,519 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311131dacdd61c577491384ce3cb461fb7325 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202311131dacdd61c577491384ce3cb461fb7325 2023-11-13 04:56:00,520 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/.tmp/family1/5360c3c2d8f748e2a5a743ee0aaff9d5 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family1/5360c3c2d8f748e2a5a743ee0aaff9d5 2023-11-13 04:56:00,543 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family1/5360c3c2d8f748e2a5a743ee0aaff9d5, entries=4, sequenceid=9, filesize=5.5 K 2023-11-13 04:56:00,544 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/.tmp/family2/2fa0dadcd098488b851609066c401e9f as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family2/2fa0dadcd098488b851609066c401e9f 2023-11-13 04:56:00,548 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family2/2fa0dadcd098488b851609066c401e9f, entries=2, sequenceid=9, filesize=5.1 K 2023-11-13 04:56:00,549 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for f692c4768bba87d4f27f89747545abab in 956ms, sequenceid=9, compaction requested=false 2023-11-13 04:56:00,549 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for f692c4768bba87d4f27f89747545abab: 2023-11-13 04:56:00,549 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1699851356777.f692c4768bba87d4f27f89747545abab. 2023-11-13 04:56:00,549 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-13 04:56:00,891 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311136355abb5ba184448a0dc1b82fe311e6f to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202311136355abb5ba184448a0dc1b82fe311e6f 2023-11-13 04:56:00,924 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/.tmp/family2/89935e70992c4ce2a7a9b5eeb46eeac0 2023-11-13 04:56:00,927 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/.tmp/family1/fa7f3d3fa4ab48ce896cf397b9ed0352 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family1/fa7f3d3fa4ab48ce896cf397b9ed0352 2023-11-13 04:56:00,950 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family1/fa7f3d3fa4ab48ce896cf397b9ed0352, entries=4, sequenceid=9, filesize=5.5 K 2023-11-13 04:56:00,951 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/.tmp/family2/89935e70992c4ce2a7a9b5eeb46eeac0 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family2/89935e70992c4ce2a7a9b5eeb46eeac0 2023-11-13 04:56:00,954 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family2/89935e70992c4ce2a7a9b5eeb46eeac0, entries=2, sequenceid=9, filesize=5.1 K 2023-11-13 04:56:00,955 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 88c06180dda7a041f01d4b128564bf13 in 1362ms, sequenceid=9, compaction requested=false 2023-11-13 04:56:00,955 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 88c06180dda7a041f01d4b128564bf13: 2023-11-13 04:56:00,955 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1699851356777.88c06180dda7a041f01d4b128564bf13. 2023-11-13 04:56:00,955 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-13 04:56:01,296 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/.tmp/family2/ba4a3c9c920840ad80a404e2d5475197 2023-11-13 04:56:01,300 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/.tmp/family1/34b1558e458747b48b3844048308dede as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family1/34b1558e458747b48b3844048308dede 2023-11-13 04:56:01,322 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family1/34b1558e458747b48b3844048308dede, entries=4, sequenceid=9, filesize=5.5 K 2023-11-13 04:56:01,323 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/.tmp/family2/ba4a3c9c920840ad80a404e2d5475197 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family2/ba4a3c9c920840ad80a404e2d5475197 2023-11-13 04:56:01,326 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family2/ba4a3c9c920840ad80a404e2d5475197, entries=2, sequenceid=9, filesize=5.1 K 2023-11-13 04:56:01,327 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 812b4480b089b56a87a7dec53ca31d1a in 1734ms, sequenceid=9, compaction requested=false 2023-11-13 04:56:01,327 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 812b4480b089b56a87a7dec53ca31d1a: 2023-11-13 04:56:01,327 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1699851356777.812b4480b089b56a87a7dec53ca31d1a. 2023-11-13 04:56:01,327 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-13 04:56:01,327 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-13 04:56:01,327 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:01,327 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-13 04:56:01,327 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-13 04:56:01,329 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:01,329 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-13 04:56:01,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:01,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:56:01,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:56:01,329 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-13 04:56:01,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:56:01,329 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:56:01,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:56:01,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-13 04:56:01,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:01,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:56:01,331 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-13 04:56:01,331 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f3a23d0[Count = 0] remaining members to acquire global barrier 2023-11-13 04:56:01,331 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-13 04:56:01,331 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-13 04:56:01,333 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-13 04:56:01,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-13 04:56:01,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-13 04:56:01,333 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-13 04:56:01,333 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-13 04:56:01,333 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:56:01,333 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:01,334 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:56:01,335 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:01,335 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-13 04:56:01,335 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:56:01,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:01,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:56:01,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:56:01,335 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-13 04:56:01,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:56:01,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:56:01,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-13 04:56:01,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:01,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:56:01,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-13 04:56:01,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:01,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:56:01,337 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-13 04:56:01,337 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-13 04:56:01,337 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:56:01,338 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:56:01,338 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-13 04:56:01,338 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:56:01,339 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-13 04:56:01,339 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-13 04:56:01,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-13 04:56:01,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-13 04:56:01,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:56:01,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:56:01,339 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:56:01,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-13 04:56:01,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:56:01,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:56:01,340 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:01,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:56:01,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-13 04:56:01,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-13 04:56:01,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:56:01,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-13 04:56:01,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:01,341 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:01,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:56:01,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-13 04:56:01,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:01,343 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:01,343 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-13 04:56:01,343 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:56:01,344 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-13 04:56:01,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:56:01,344 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:01,344 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-13 04:56:01,344 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:56:01,344 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:56:01,344 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:56:01,344 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-13 04:56:01,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:56:01,344 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-13 04:56:01,344 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-13 04:56:01,344 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-13 04:56:01,344 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:56:01,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:56:01,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:56:01,444 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:56:01,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:56:01,446 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1699851356777.88c06180dda7a041f01d4b128564bf13. with WAL disabled. Data may be lost in the event of a crash. 2023-11-13 04:56:01,446 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1699851356777.f692c4768bba87d4f27f89747545abab. with WAL disabled. Data may be lost in the event of a crash. 2023-11-13 04:56:01,446 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1699851356777.812b4480b089b56a87a7dec53ca31d1a. with WAL disabled. Data may be lost in the event of a crash. 2023-11-13 04:56:01,448 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:56:01,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-13 04:56:01,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-13 04:56:01,450 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-13 04:56:01,450 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:56:01,450 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-13 04:56:01,450 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-13 04:56:01,450 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-13 04:56:01,451 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-13 04:56:01,453 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:01,453 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:56:01,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:56:01,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:56:01,453 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:01,453 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:56:01,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-13 04:56:01,454 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-13 04:56:01,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:56:01,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-13 04:56:01,454 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-13 04:56:01,454 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-13 04:56:01,454 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-13 04:56:01,454 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-13 04:56:01,454 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:56:01,454 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-13 04:56:01,455 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1699851356777.88c06180dda7a041f01d4b128564bf13. 2023-11-13 04:56:01,455 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1699851356777.88c06180dda7a041f01d4b128564bf13. started... 2023-11-13 04:56:01,455 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-13 04:56:01,455 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:56:01,455 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1699851356777.f692c4768bba87d4f27f89747545abab. 2023-11-13 04:56:01,455 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1699851356777.812b4480b089b56a87a7dec53ca31d1a. 2023-11-13 04:56:01,455 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1699851356777.f692c4768bba87d4f27f89747545abab. started... 2023-11-13 04:56:01,455 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 88c06180dda7a041f01d4b128564bf13 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-13 04:56:01,455 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1699851356777.812b4480b089b56a87a7dec53ca31d1a. started... 2023-11-13 04:56:01,455 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing f692c4768bba87d4f27f89747545abab 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-13 04:56:01,455 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 812b4480b089b56a87a7dec53ca31d1a 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-13 04:56:01,897 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311136eeebf627a794f6281d668ce14da651e to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311136eeebf627a794f6281d668ce14da651e 2023-11-13 04:56:01,897 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231113f7933e0ded204c058b9431a3e7ec4cb8 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231113f7933e0ded204c058b9431a3e7ec4cb8 2023-11-13 04:56:01,900 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311137d89b4ba49504559a2844f6610d453c3 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311137d89b4ba49504559a2844f6610d453c3 2023-11-13 04:56:01,914 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/.tmp/family1/cc39fdcf293a4eeaa36ee66f28028748 2023-11-13 04:56:01,917 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/.tmp/family1/faf038e7374f47f9a26260a649fbde2c 2023-11-13 04:56:01,917 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/.tmp/family1/39a4ed5337584280be0a4431aa3fb2bb 2023-11-13 04:56:01,968 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311138653b5dd7c1e472f8a277cd2ebd7f048 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202311138653b5dd7c1e472f8a277cd2ebd7f048 2023-11-13 04:56:01,973 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/.tmp/family2/eb9e51bd68ca4847a968b1f749e5bffd 2023-11-13 04:56:01,976 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/.tmp/family1/39a4ed5337584280be0a4431aa3fb2bb as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family1/39a4ed5337584280be0a4431aa3fb2bb 2023-11-13 04:56:01,999 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family1/39a4ed5337584280be0a4431aa3fb2bb, entries=4, sequenceid=13, filesize=5.5 K 2023-11-13 04:56:02,000 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/.tmp/family2/eb9e51bd68ca4847a968b1f749e5bffd as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family2/eb9e51bd68ca4847a968b1f749e5bffd 2023-11-13 04:56:02,004 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family2/eb9e51bd68ca4847a968b1f749e5bffd, entries=2, sequenceid=13, filesize=5.1 K 2023-11-13 04:56:02,004 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for f692c4768bba87d4f27f89747545abab in 549ms, sequenceid=13, compaction requested=true 2023-11-13 04:56:02,005 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for f692c4768bba87d4f27f89747545abab: 2023-11-13 04:56:02,005 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1699851356777.f692c4768bba87d4f27f89747545abab. 2023-11-13 04:56:02,005 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-13 04:56:02,356 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231113d5a72305a46240f881a40096b98032b1 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231113d5a72305a46240f881a40096b98032b1 2023-11-13 04:56:02,362 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/.tmp/family2/b4de18e1e8e54877948bcb5aca0e9196 2023-11-13 04:56:02,362 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311130d5c4b196163470fa270918d16358a12 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202311130d5c4b196163470fa270918d16358a12 2023-11-13 04:56:02,367 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/.tmp/family1/faf038e7374f47f9a26260a649fbde2c as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family1/faf038e7374f47f9a26260a649fbde2c 2023-11-13 04:56:02,392 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family1/faf038e7374f47f9a26260a649fbde2c, entries=4, sequenceid=13, filesize=5.5 K 2023-11-13 04:56:02,393 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/.tmp/family2/b4de18e1e8e54877948bcb5aca0e9196 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family2/b4de18e1e8e54877948bcb5aca0e9196 2023-11-13 04:56:02,397 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family2/b4de18e1e8e54877948bcb5aca0e9196, entries=2, sequenceid=13, filesize=5.1 K 2023-11-13 04:56:02,397 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 812b4480b089b56a87a7dec53ca31d1a in 942ms, sequenceid=13, compaction requested=true 2023-11-13 04:56:02,397 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 812b4480b089b56a87a7dec53ca31d1a: 2023-11-13 04:56:02,397 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1699851356777.812b4480b089b56a87a7dec53ca31d1a. 2023-11-13 04:56:02,398 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-13 04:56:02,772 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/.tmp/family2/e2c5fbfa4055464195534c9266d5d8ee 2023-11-13 04:56:02,776 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/.tmp/family1/cc39fdcf293a4eeaa36ee66f28028748 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family1/cc39fdcf293a4eeaa36ee66f28028748 2023-11-13 04:56:02,799 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family1/cc39fdcf293a4eeaa36ee66f28028748, entries=4, sequenceid=13, filesize=5.5 K 2023-11-13 04:56:02,799 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/.tmp/family2/e2c5fbfa4055464195534c9266d5d8ee as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family2/e2c5fbfa4055464195534c9266d5d8ee 2023-11-13 04:56:02,802 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family2/e2c5fbfa4055464195534c9266d5d8ee, entries=2, sequenceid=13, filesize=5.1 K 2023-11-13 04:56:02,803 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 88c06180dda7a041f01d4b128564bf13 in 1348ms, sequenceid=13, compaction requested=true 2023-11-13 04:56:02,803 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 88c06180dda7a041f01d4b128564bf13: 2023-11-13 04:56:02,803 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1699851356777.88c06180dda7a041f01d4b128564bf13. 2023-11-13 04:56:02,803 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-13 04:56:02,803 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-13 04:56:02,803 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:02,803 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-13 04:56:02,803 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-13 04:56:02,805 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-13 04:56:02,805 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:02,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:02,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:56:02,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:56:02,806 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-13 04:56:02,806 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:56:02,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:56:02,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:56:02,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-13 04:56:02,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:02,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:56:02,807 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-13 04:56:02,807 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f91a743[Count = 0] remaining members to acquire global barrier 2023-11-13 04:56:02,807 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-13 04:56:02,807 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-13 04:56:02,808 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-13 04:56:02,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-13 04:56:02,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-13 04:56:02,808 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-13 04:56:02,808 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-13 04:56:02,808 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:56:02,808 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:02,809 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:56:02,810 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:02,810 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-13 04:56:02,810 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:56:02,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:02,810 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-13 04:56:02,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:56:02,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:56:02,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:56:02,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:56:02,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-13 04:56:02,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:02,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:56:02,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-13 04:56:02,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:02,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:56:02,812 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-13 04:56:02,812 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-13 04:56:02,812 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:56:02,812 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:56:02,812 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-13 04:56:02,812 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:56:02,815 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-13 04:56:02,815 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-13 04:56:02,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-13 04:56:02,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-13 04:56:02,815 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:56:02,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-13 04:56:02,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:56:02,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:56:02,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:56:02,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:56:02,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:56:02,816 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:02,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-13 04:56:02,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-13 04:56:02,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:56:02,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-13 04:56:02,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:02,817 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:02,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:56:02,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-13 04:56:02,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:02,819 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:02,819 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:56:02,819 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-13 04:56:02,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:56:02,819 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-13 04:56:02,820 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:56:02,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:56:02,819 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:56:02,819 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-13 04:56:02,820 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:02,820 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-13 04:56:02,820 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-13 04:56:02,820 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-13 04:56:02,819 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:56:02,820 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-13 04:56:02,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:56:02,820 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:56:02,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:56:02,920 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:56:02,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:56:02,922 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1699851356777.88c06180dda7a041f01d4b128564bf13. with WAL disabled. Data may be lost in the event of a crash. 2023-11-13 04:56:02,922 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1699851356777.f692c4768bba87d4f27f89747545abab. with WAL disabled. Data may be lost in the event of a crash. 2023-11-13 04:56:02,922 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1699851356777.812b4480b089b56a87a7dec53ca31d1a. with WAL disabled. Data may be lost in the event of a crash. 2023-11-13 04:56:02,924 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:56:02,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-13 04:56:02,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-13 04:56:02,926 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-13 04:56:02,926 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:56:02,926 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-13 04:56:02,926 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-13 04:56:02,927 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-13 04:56:02,927 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-13 04:56:02,928 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:02,928 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:56:02,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:56:02,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:56:02,928 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:02,928 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:56:02,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-13 04:56:02,929 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-13 04:56:02,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:56:02,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-13 04:56:02,929 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-13 04:56:02,929 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-13 04:56:02,929 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-13 04:56:02,929 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-13 04:56:02,929 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:56:02,930 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-13 04:56:02,930 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1699851356777.88c06180dda7a041f01d4b128564bf13. 2023-11-13 04:56:02,930 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1699851356777.812b4480b089b56a87a7dec53ca31d1a. 2023-11-13 04:56:02,930 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1699851356777.88c06180dda7a041f01d4b128564bf13. started... 2023-11-13 04:56:02,930 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1699851356777.f692c4768bba87d4f27f89747545abab. 2023-11-13 04:56:02,930 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1699851356777.f692c4768bba87d4f27f89747545abab. started... 2023-11-13 04:56:02,930 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-13 04:56:02,930 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 88c06180dda7a041f01d4b128564bf13 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-13 04:56:02,930 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing f692c4768bba87d4f27f89747545abab 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-13 04:56:02,930 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:56:02,930 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1699851356777.812b4480b089b56a87a7dec53ca31d1a. started... 2023-11-13 04:56:02,930 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 812b4480b089b56a87a7dec53ca31d1a 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-13 04:56:02,983 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231113f0ebbc65e3de41208fe46dd33ac47da2 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231113f0ebbc65e3de41208fe46dd33ac47da2 2023-11-13 04:56:03,002 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/.tmp/family1/7198b42363f84e64b15a6561dce28082 2023-11-13 04:56:03,025 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-13 04:56:03,025 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1e55ec38 to 127.0.0.1:51072 2023-11-13 04:56:03,025 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-13 04:56:03,025 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-13 04:56:03,025 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7f62dd6b to 127.0.0.1:51072 2023-11-13 04:56:03,025 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-13 04:56:03,375 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111389b5256b0a714f1c9e884958335af72d to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023111389b5256b0a714f1c9e884958335af72d 2023-11-13 04:56:03,375 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231113da061b26bbdd4e6cb2d7bb167656417a to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231113da061b26bbdd4e6cb2d7bb167656417a 2023-11-13 04:56:03,389 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/.tmp/family1/b60a1f637a7347209f1c825b5efb82d7 2023-11-13 04:56:03,389 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/.tmp/family1/556c2fed756f4767bd345fb4b87ae540 2023-11-13 04:56:03,431 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023111310190b00355444639099f93d89b1d96b to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023111310190b00355444639099f93d89b1d96b 2023-11-13 04:56:03,431 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231113cb5e42c06c6b445593c0c0ad39e875b4 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231113cb5e42c06c6b445593c0c0ad39e875b4 2023-11-13 04:56:03,435 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/.tmp/family2/73d717ec61bc432d990dce52931ab522 2023-11-13 04:56:03,437 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/.tmp/family1/556c2fed756f4767bd345fb4b87ae540 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family1/556c2fed756f4767bd345fb4b87ae540 2023-11-13 04:56:03,449 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311132bb8796ef56a412589c9dfba819278fe to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202311132bb8796ef56a412589c9dfba819278fe 2023-11-13 04:56:03,453 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/.tmp/family2/ff973a5ace8d4c99a91d11b0934d5ff3 2023-11-13 04:56:03,456 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/.tmp/family1/7198b42363f84e64b15a6561dce28082 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family1/7198b42363f84e64b15a6561dce28082 2023-11-13 04:56:03,462 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family1/556c2fed756f4767bd345fb4b87ae540, entries=4, sequenceid=17, filesize=5.5 K 2023-11-13 04:56:03,463 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/.tmp/family2/73d717ec61bc432d990dce52931ab522 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family2/73d717ec61bc432d990dce52931ab522 2023-11-13 04:56:03,469 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family2/73d717ec61bc432d990dce52931ab522, entries=2, sequenceid=17, filesize=5.1 K 2023-11-13 04:56:03,470 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for f692c4768bba87d4f27f89747545abab in 540ms, sequenceid=17, compaction requested=true 2023-11-13 04:56:03,470 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for f692c4768bba87d4f27f89747545abab: 2023-11-13 04:56:03,470 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1699851356777.f692c4768bba87d4f27f89747545abab. 2023-11-13 04:56:03,470 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-13 04:56:03,485 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family1/7198b42363f84e64b15a6561dce28082, entries=4, sequenceid=17, filesize=5.5 K 2023-11-13 04:56:03,486 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/.tmp/family2/ff973a5ace8d4c99a91d11b0934d5ff3 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family2/ff973a5ace8d4c99a91d11b0934d5ff3 2023-11-13 04:56:03,489 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family2/ff973a5ace8d4c99a91d11b0934d5ff3, entries=2, sequenceid=17, filesize=5.1 K 2023-11-13 04:56:03,490 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 88c06180dda7a041f01d4b128564bf13 in 560ms, sequenceid=17, compaction requested=true 2023-11-13 04:56:03,490 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 88c06180dda7a041f01d4b128564bf13: 2023-11-13 04:56:03,490 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1699851356777.88c06180dda7a041f01d4b128564bf13. 2023-11-13 04:56:03,490 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-13 04:56:03,532 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-13 04:56:03,835 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/.tmp/family2/0df6871fb6634910b36a0e0b95b1a578 2023-11-13 04:56:03,839 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/.tmp/family1/b60a1f637a7347209f1c825b5efb82d7 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family1/b60a1f637a7347209f1c825b5efb82d7 2023-11-13 04:56:03,862 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family1/b60a1f637a7347209f1c825b5efb82d7, entries=4, sequenceid=17, filesize=5.5 K 2023-11-13 04:56:03,862 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/.tmp/family2/0df6871fb6634910b36a0e0b95b1a578 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family2/0df6871fb6634910b36a0e0b95b1a578 2023-11-13 04:56:03,866 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family2/0df6871fb6634910b36a0e0b95b1a578, entries=2, sequenceid=17, filesize=5.1 K 2023-11-13 04:56:03,866 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 812b4480b089b56a87a7dec53ca31d1a in 936ms, sequenceid=17, compaction requested=true 2023-11-13 04:56:03,866 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 812b4480b089b56a87a7dec53ca31d1a: 2023-11-13 04:56:03,866 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1699851356777.812b4480b089b56a87a7dec53ca31d1a. 2023-11-13 04:56:03,866 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-13 04:56:03,866 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-13 04:56:03,867 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:03,867 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-13 04:56:03,867 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-13 04:56:03,868 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-13 04:56:03,868 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:03,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:03,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:56:03,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:56:03,869 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-13 04:56:03,869 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:56:03,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:56:03,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:56:03,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-13 04:56:03,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:03,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:56:03,870 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-13 04:56:03,870 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@419beae1[Count = 0] remaining members to acquire global barrier 2023-11-13 04:56:03,871 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-13 04:56:03,871 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-13 04:56:03,874 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-13 04:56:03,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-13 04:56:03,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-13 04:56:03,874 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-13 04:56:03,874 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-13 04:56:03,874 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:03,874 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:56:03,874 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:56:03,877 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-13 04:56:03,877 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:03,877 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:56:03,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:03,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:56:03,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:56:03,877 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-13 04:56:03,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:56:03,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:56:03,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-13 04:56:03,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:03,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:56:03,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-13 04:56:03,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:03,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:56:03,879 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-13 04:56:03,879 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-13 04:56:03,879 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:56:03,879 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:56:03,879 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-13 04:56:03,879 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:56:03,881 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-13 04:56:03,881 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-13 04:56:03,881 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:56:03,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-13 04:56:03,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:56:03,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:56:03,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-13 04:56:03,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-13 04:56:03,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:56:03,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:56:03,881 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:03,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:56:03,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-13 04:56:03,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-13 04:56:03,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:56:03,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-13 04:56:03,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:03,883 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:03,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:56:03,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-13 04:56:03,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:03,885 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:03,885 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:56:03,885 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-13 04:56:03,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:56:03,885 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-13 04:56:03,885 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:56:03,885 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-13 04:56:03,885 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:56:03,885 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:56:03,885 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:03,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:56:03,885 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-13 04:56:03,885 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-13 04:56:03,885 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:56:03,885 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-13 04:56:03,886 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-13 04:56:03,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:56:03,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:56:03,986 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:56:03,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:56:03,995 DEBUG [Listener at localhost/34517] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-13 04:56:04,002 DEBUG [Listener at localhost/34517] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-13 04:56:04,011 DEBUG [Listener at localhost/34517] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-13 04:56:04,011 DEBUG [Listener at localhost/34517] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-13 04:56:04,092 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-13 04:56:04,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-13 04:56:04,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-13 04:56:04,094 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-13 04:56:04,094 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:56:04,094 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-13 04:56:04,094 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-13 04:56:04,094 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-13 04:56:04,094 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-13 04:56:04,095 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:04,095 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:56:04,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:56:04,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:56:04,096 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:04,096 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-13 04:56:04,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-13 04:56:04,096 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-13 04:56:04,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-13 04:56:04,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-13 04:56:04,097 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-13 04:56:04,097 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-13 04:56:04,097 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-13 04:56:04,097 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-13 04:56:04,097 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-13 04:56:04,097 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-13 04:56:04,097 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1699851356777.88c06180dda7a041f01d4b128564bf13. 2023-11-13 04:56:04,097 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1699851356777.88c06180dda7a041f01d4b128564bf13. started... 2023-11-13 04:56:04,097 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 88c06180dda7a041f01d4b128564bf13 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-13 04:56:04,101 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1699851356777.812b4480b089b56a87a7dec53ca31d1a. 2023-11-13 04:56:04,101 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-13 04:56:04,101 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-13 04:56:04,101 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1699851356777.812b4480b089b56a87a7dec53ca31d1a. started... 2023-11-13 04:56:04,101 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1699851356777.f692c4768bba87d4f27f89747545abab. 2023-11-13 04:56:04,101 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 812b4480b089b56a87a7dec53ca31d1a 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-13 04:56:04,101 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1699851356777.f692c4768bba87d4f27f89747545abab. started... 2023-11-13 04:56:04,101 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing f692c4768bba87d4f27f89747545abab 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-13 04:56:04,159 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/.tmp/family1/85ec853ace9f4160945ab1f59448c177 2023-11-13 04:56:04,181 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 85ec853ace9f4160945ab1f59448c177 2023-11-13 04:56:04,550 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/.tmp/family1/2c72d231a8074bf4859ab1c00dc5ddb9 2023-11-13 04:56:04,570 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/.tmp/family1/2cd4a0d624a94f62bb077ce52547e335 2023-11-13 04:56:04,574 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2c72d231a8074bf4859ab1c00dc5ddb9 2023-11-13 04:56:04,594 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2cd4a0d624a94f62bb077ce52547e335 2023-11-13 04:56:04,994 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/.tmp/family2/b330732ea1a746739b51a97c0658481f 2023-11-13 04:56:04,998 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b330732ea1a746739b51a97c0658481f 2023-11-13 04:56:04,998 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/.tmp/family1/85ec853ace9f4160945ab1f59448c177 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family1/85ec853ace9f4160945ab1f59448c177 2023-11-13 04:56:05,008 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/.tmp/family2/df50e80b05504877903fca1b9724b6a2 2023-11-13 04:56:05,011 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for df50e80b05504877903fca1b9724b6a2 2023-11-13 04:56:05,011 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/.tmp/family1/2cd4a0d624a94f62bb077ce52547e335 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family1/2cd4a0d624a94f62bb077ce52547e335 2023-11-13 04:56:05,023 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 85ec853ace9f4160945ab1f59448c177 2023-11-13 04:56:05,023 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family1/85ec853ace9f4160945ab1f59448c177, entries=3, sequenceid=23, filesize=5.2 K 2023-11-13 04:56:05,024 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/.tmp/family2/b330732ea1a746739b51a97c0658481f as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family2/b330732ea1a746739b51a97c0658481f 2023-11-13 04:56:05,027 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b330732ea1a746739b51a97c0658481f 2023-11-13 04:56:05,028 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family2/b330732ea1a746739b51a97c0658481f, entries=1, sequenceid=23, filesize=5.0 K 2023-11-13 04:56:05,028 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 812b4480b089b56a87a7dec53ca31d1a in 927ms, sequenceid=23, compaction requested=true 2023-11-13 04:56:05,028 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 812b4480b089b56a87a7dec53ca31d1a: 2023-11-13 04:56:05,028 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1699851356777.812b4480b089b56a87a7dec53ca31d1a. 2023-11-13 04:56:05,028 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-13 04:56:05,033 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2cd4a0d624a94f62bb077ce52547e335 2023-11-13 04:56:05,033 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family1/2cd4a0d624a94f62bb077ce52547e335, entries=3, sequenceid=23, filesize=5.2 K 2023-11-13 04:56:05,034 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/.tmp/family2/df50e80b05504877903fca1b9724b6a2 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family2/df50e80b05504877903fca1b9724b6a2 2023-11-13 04:56:05,037 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for df50e80b05504877903fca1b9724b6a2 2023-11-13 04:56:05,037 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family2/df50e80b05504877903fca1b9724b6a2, entries=1, sequenceid=23, filesize=5.0 K 2023-11-13 04:56:05,038 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for f692c4768bba87d4f27f89747545abab in 937ms, sequenceid=23, compaction requested=true 2023-11-13 04:56:05,038 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for f692c4768bba87d4f27f89747545abab: 2023-11-13 04:56:05,038 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1699851356777.f692c4768bba87d4f27f89747545abab. 2023-11-13 04:56:05,038 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-13 04:56:05,394 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/.tmp/family2/4318acfea8974ac484dc3198ff0e4a33 2023-11-13 04:56:05,398 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4318acfea8974ac484dc3198ff0e4a33 2023-11-13 04:56:05,398 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/.tmp/family1/2c72d231a8074bf4859ab1c00dc5ddb9 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family1/2c72d231a8074bf4859ab1c00dc5ddb9 2023-11-13 04:56:05,421 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2c72d231a8074bf4859ab1c00dc5ddb9 2023-11-13 04:56:05,421 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family1/2c72d231a8074bf4859ab1c00dc5ddb9, entries=3, sequenceid=23, filesize=5.2 K 2023-11-13 04:56:05,422 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/.tmp/family2/4318acfea8974ac484dc3198ff0e4a33 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family2/4318acfea8974ac484dc3198ff0e4a33 2023-11-13 04:56:05,425 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4318acfea8974ac484dc3198ff0e4a33 2023-11-13 04:56:05,425 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family2/4318acfea8974ac484dc3198ff0e4a33, entries=1, sequenceid=23, filesize=5.0 K 2023-11-13 04:56:05,426 INFO [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 88c06180dda7a041f01d4b128564bf13 in 1329ms, sequenceid=23, compaction requested=true 2023-11-13 04:56:05,426 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 88c06180dda7a041f01d4b128564bf13: 2023-11-13 04:56:05,426 DEBUG [rs(jenkins-hbase4.apache.org,41657,1699851201532)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1699851356777.88c06180dda7a041f01d4b128564bf13. 2023-11-13 04:56:05,426 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-13 04:56:05,426 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-13 04:56:05,426 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:05,426 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-13 04:56:05,426 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-13 04:56:05,428 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:05,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:05,428 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-13 04:56:05,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:56:05,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:56:05,428 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-13 04:56:05,428 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-13 04:56:05,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:56:05,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:56:05,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-13 04:56:05,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:05,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:56:05,430 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41657,1699851201532' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-13 04:56:05,430 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4a058607[Count = 0] remaining members to acquire global barrier 2023-11-13 04:56:05,430 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-13 04:56:05,430 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-13 04:56:05,431 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-13 04:56:05,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-13 04:56:05,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-13 04:56:05,431 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-13 04:56:05,431 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-13 04:56:05,431 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,41657,1699851201532' in zk 2023-11-13 04:56:05,431 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:05,431 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-13 04:56:05,433 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-13 04:56:05,433 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:05,433 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:56:05,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:05,433 DEBUG [member: 'jenkins-hbase4.apache.org,41657,1699851201532' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-13 04:56:05,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:56:05,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:56:05,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:56:05,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:56:05,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-13 04:56:05,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:05,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:56:05,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-13 04:56:05,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:05,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,41657,1699851201532': 2023-11-13 04:56:05,435 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41657,1699851201532' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-13 04:56:05,435 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-13 04:56:05,435 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-13 04:56:05,435 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-13 04:56:05,435 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-13 04:56:05,435 INFO [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-13 04:56:05,438 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-13 04:56:05,438 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-13 04:56:05,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-13 04:56:05,438 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:56:05,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-13 04:56:05,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-13 04:56:05,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-13 04:56:05,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-13 04:56:05,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:56:05,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:56:05,438 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:05,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-13 04:56:05,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-13 04:56:05,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-13 04:56:05,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-13 04:56:05,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-13 04:56:05,439 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:05,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:05,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-13 04:56:05,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-13 04:56:05,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:05,442 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:05,442 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-13 04:56:05,442 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-13 04:56:05,442 DEBUG [(jenkins-hbase4.apache.org,33831,1699851200322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-13 04:56:05,442 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-13 04:56:05,442 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-13 04:56:05,442 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-13 04:56:05,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-13 04:56:05,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-13 04:56:05,442 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-13 04:56:05,442 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-13 04:56:05,442 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:05,442 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-13 04:56:05,442 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-13 04:56:05,442 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-13 04:56:05,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-13 04:56:05,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-13 04:56:05,443 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-13 04:56:05,443 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-13 04:56:05,543 DEBUG [Listener at localhost/34517] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-13 04:56:05,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33831] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-13 04:56:05,544 DEBUG [Listener at localhost/34517] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-13 04:56:05,544 DEBUG [Listener at localhost/34517] regionserver.HStore(1912): 88c06180dda7a041f01d4b128564bf13/family1 is initiating major compaction (all files) 2023-11-13 04:56:05,545 INFO [Listener at localhost/34517] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-13 04:56:05,545 INFO [Listener at localhost/34517] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-13 04:56:05,545 INFO [Listener at localhost/34517] regionserver.HRegion(2259): Starting compaction of 88c06180dda7a041f01d4b128564bf13/family1 in testMajorCompactionFromAdmin,,1699851356777.88c06180dda7a041f01d4b128564bf13. 2023-11-13 04:56:05,545 INFO [Listener at localhost/34517] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family1/55133de0a60e4e2db0dd8e2e33b003b4, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family1/fa7f3d3fa4ab48ce896cf397b9ed0352, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family1/cc39fdcf293a4eeaa36ee66f28028748, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family1/7198b42363f84e64b15a6561dce28082, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family1/2c72d231a8074bf4859ab1c00dc5ddb9] into tmpdir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/.tmp, totalSize=27.1 K 2023-11-13 04:56:05,545 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 55133de0a60e4e2db0dd8e2e33b003b4, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699851358920 2023-11-13 04:56:05,546 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting fa7f3d3fa4ab48ce896cf397b9ed0352, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699851359584 2023-11-13 04:56:05,546 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting cc39fdcf293a4eeaa36ee66f28028748, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699851361446 2023-11-13 04:56:05,547 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 7198b42363f84e64b15a6561dce28082, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699851362922 2023-11-13 04:56:05,547 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 2c72d231a8074bf4859ab1c00dc5ddb9, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-13 04:56:05,557 INFO [Listener at localhost/34517] throttle.PressureAwareThroughputController(145): 88c06180dda7a041f01d4b128564bf13#family1#compaction#197 average throughput is 0.43 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-13 04:56:05,592 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023111320433e8c98ab49128f8e0d4e3cc534d4_del 2023-11-13 04:56:05,593 INFO [Listener at localhost/34517] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111320433e8c98ab49128f8e0d4e3cc534d4_del to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023111320433e8c98ab49128f8e0d4e3cc534d4_del 2023-11-13 04:56:06,461 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6a42170ca38a45d3b13538cdbd632f7f 2023-11-13 04:56:06,462 DEBUG [Listener at localhost/34517] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/.tmp/family1/6a42170ca38a45d3b13538cdbd632f7f as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family1/6a42170ca38a45d3b13538cdbd632f7f 2023-11-13 04:56:06,483 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6a42170ca38a45d3b13538cdbd632f7f 2023-11-13 04:56:06,484 INFO [Listener at localhost/34517] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 88c06180dda7a041f01d4b128564bf13/family1 of 88c06180dda7a041f01d4b128564bf13 into 6a42170ca38a45d3b13538cdbd632f7f(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-13 04:56:06,484 DEBUG [Listener at localhost/34517] regionserver.HRegion(2289): Compaction status journal for 88c06180dda7a041f01d4b128564bf13: 2023-11-13 04:56:06,484 DEBUG [Listener at localhost/34517] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-13 04:56:06,485 DEBUG [Listener at localhost/34517] regionserver.HStore(1912): 88c06180dda7a041f01d4b128564bf13/family2 is initiating major compaction (all files) 2023-11-13 04:56:06,485 INFO [Listener at localhost/34517] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-13 04:56:06,485 INFO [Listener at localhost/34517] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-13 04:56:06,485 INFO [Listener at localhost/34517] regionserver.HRegion(2259): Starting compaction of 88c06180dda7a041f01d4b128564bf13/family2 in testMajorCompactionFromAdmin,,1699851356777.88c06180dda7a041f01d4b128564bf13. 2023-11-13 04:56:06,485 INFO [Listener at localhost/34517] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family2/244851e6d2774c18a1356557bf305e40, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family2/89935e70992c4ce2a7a9b5eeb46eeac0, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family2/e2c5fbfa4055464195534c9266d5d8ee, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family2/ff973a5ace8d4c99a91d11b0934d5ff3, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family2/4318acfea8974ac484dc3198ff0e4a33] into tmpdir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/.tmp, totalSize=25.4 K 2023-11-13 04:56:06,485 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 244851e6d2774c18a1356557bf305e40, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699851358920 2023-11-13 04:56:06,486 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 89935e70992c4ce2a7a9b5eeb46eeac0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699851359584 2023-11-13 04:56:06,486 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting e2c5fbfa4055464195534c9266d5d8ee, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699851361446 2023-11-13 04:56:06,487 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting ff973a5ace8d4c99a91d11b0934d5ff3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699851362922 2023-11-13 04:56:06,487 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 4318acfea8974ac484dc3198ff0e4a33, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-13 04:56:06,495 INFO [Listener at localhost/34517] throttle.PressureAwareThroughputController(145): 88c06180dda7a041f01d4b128564bf13#family2#compaction#198 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-13 04:56:06,515 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family1/55133de0a60e4e2db0dd8e2e33b003b4, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family1/fa7f3d3fa4ab48ce896cf397b9ed0352, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family1/cc39fdcf293a4eeaa36ee66f28028748, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family1/7198b42363f84e64b15a6561dce28082, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family1/2c72d231a8074bf4859ab1c00dc5ddb9] to archive 2023-11-13 04:56:06,516 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:56:06,517 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family1/55133de0a60e4e2db0dd8e2e33b003b4 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family1/55133de0a60e4e2db0dd8e2e33b003b4 2023-11-13 04:56:06,518 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family1/fa7f3d3fa4ab48ce896cf397b9ed0352 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family1/fa7f3d3fa4ab48ce896cf397b9ed0352 2023-11-13 04:56:06,519 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family1/cc39fdcf293a4eeaa36ee66f28028748 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family1/cc39fdcf293a4eeaa36ee66f28028748 2023-11-13 04:56:06,520 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family1/7198b42363f84e64b15a6561dce28082 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family1/7198b42363f84e64b15a6561dce28082 2023-11-13 04:56:06,521 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family1/2c72d231a8074bf4859ab1c00dc5ddb9 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family1/2c72d231a8074bf4859ab1c00dc5ddb9 2023-11-13 04:56:06,903 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023111341821821da764e2e9baf3d379e91931c_del 2023-11-13 04:56:06,903 INFO [Listener at localhost/34517] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111341821821da764e2e9baf3d379e91931c_del to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023111341821821da764e2e9baf3d379e91931c_del 2023-11-13 04:56:07,716 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 78e9411b56654a46ac221806b85f3b26 2023-11-13 04:56:07,717 DEBUG [Listener at localhost/34517] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/.tmp/family2/78e9411b56654a46ac221806b85f3b26 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family2/78e9411b56654a46ac221806b85f3b26 2023-11-13 04:56:07,720 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 78e9411b56654a46ac221806b85f3b26 2023-11-13 04:56:07,720 INFO [Listener at localhost/34517] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 88c06180dda7a041f01d4b128564bf13/family2 of 88c06180dda7a041f01d4b128564bf13 into 78e9411b56654a46ac221806b85f3b26(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-13 04:56:07,721 DEBUG [Listener at localhost/34517] regionserver.HRegion(2289): Compaction status journal for 88c06180dda7a041f01d4b128564bf13: 2023-11-13 04:56:07,721 DEBUG [Listener at localhost/34517] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-13 04:56:07,721 DEBUG [Listener at localhost/34517] regionserver.HStore(1912): 812b4480b089b56a87a7dec53ca31d1a/family1 is initiating major compaction (all files) 2023-11-13 04:56:07,721 INFO [Listener at localhost/34517] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-13 04:56:07,721 INFO [Listener at localhost/34517] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-13 04:56:07,721 INFO [Listener at localhost/34517] regionserver.HRegion(2259): Starting compaction of 812b4480b089b56a87a7dec53ca31d1a/family1 in testMajorCompactionFromAdmin,2,1699851356777.812b4480b089b56a87a7dec53ca31d1a. 2023-11-13 04:56:07,722 INFO [Listener at localhost/34517] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family1/49c3e851b47f4fbcbfbf7f07fdd6e2b2, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family1/34b1558e458747b48b3844048308dede, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family1/faf038e7374f47f9a26260a649fbde2c, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family1/b60a1f637a7347209f1c825b5efb82d7, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family1/85ec853ace9f4160945ab1f59448c177] into tmpdir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/.tmp, totalSize=27.1 K 2023-11-13 04:56:07,722 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 49c3e851b47f4fbcbfbf7f07fdd6e2b2, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699851358921 2023-11-13 04:56:07,722 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 34b1558e458747b48b3844048308dede, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699851359584 2023-11-13 04:56:07,722 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting faf038e7374f47f9a26260a649fbde2c, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699851361446 2023-11-13 04:56:07,723 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting b60a1f637a7347209f1c825b5efb82d7, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699851362922 2023-11-13 04:56:07,723 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 85ec853ace9f4160945ab1f59448c177, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-13 04:56:07,730 INFO [Listener at localhost/34517] throttle.PressureAwareThroughputController(145): 812b4480b089b56a87a7dec53ca31d1a#family1#compaction#199 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-13 04:56:07,814 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family2/244851e6d2774c18a1356557bf305e40, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family2/89935e70992c4ce2a7a9b5eeb46eeac0, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family2/e2c5fbfa4055464195534c9266d5d8ee, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family2/ff973a5ace8d4c99a91d11b0934d5ff3, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family2/4318acfea8974ac484dc3198ff0e4a33] to archive 2023-11-13 04:56:07,815 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:56:07,816 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family2/244851e6d2774c18a1356557bf305e40 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family2/244851e6d2774c18a1356557bf305e40 2023-11-13 04:56:07,817 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family2/89935e70992c4ce2a7a9b5eeb46eeac0 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family2/89935e70992c4ce2a7a9b5eeb46eeac0 2023-11-13 04:56:07,818 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family2/e2c5fbfa4055464195534c9266d5d8ee to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family2/e2c5fbfa4055464195534c9266d5d8ee 2023-11-13 04:56:07,819 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family2/ff973a5ace8d4c99a91d11b0934d5ff3 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family2/ff973a5ace8d4c99a91d11b0934d5ff3 2023-11-13 04:56:07,820 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family2/4318acfea8974ac484dc3198ff0e4a33 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family2/4318acfea8974ac484dc3198ff0e4a33 2023-11-13 04:56:08,167 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023111398ade9ad0b23485a98bb766bcdd6d6c7_del 2023-11-13 04:56:08,168 INFO [Listener at localhost/34517] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111398ade9ad0b23485a98bb766bcdd6d6c7_del to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023111398ade9ad0b23485a98bb766bcdd6d6c7_del 2023-11-13 04:56:09,031 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c90511a062174a3bac95c9ee257e446d 2023-11-13 04:56:09,031 DEBUG [Listener at localhost/34517] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/.tmp/family1/c90511a062174a3bac95c9ee257e446d as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family1/c90511a062174a3bac95c9ee257e446d 2023-11-13 04:56:09,055 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c90511a062174a3bac95c9ee257e446d 2023-11-13 04:56:09,056 INFO [Listener at localhost/34517] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 812b4480b089b56a87a7dec53ca31d1a/family1 of 812b4480b089b56a87a7dec53ca31d1a into c90511a062174a3bac95c9ee257e446d(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-13 04:56:09,056 DEBUG [Listener at localhost/34517] regionserver.HRegion(2289): Compaction status journal for 812b4480b089b56a87a7dec53ca31d1a: 2023-11-13 04:56:09,056 DEBUG [Listener at localhost/34517] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-13 04:56:09,056 DEBUG [Listener at localhost/34517] regionserver.HStore(1912): 812b4480b089b56a87a7dec53ca31d1a/family2 is initiating major compaction (all files) 2023-11-13 04:56:09,056 INFO [Listener at localhost/34517] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-13 04:56:09,056 INFO [Listener at localhost/34517] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-13 04:56:09,056 INFO [Listener at localhost/34517] regionserver.HRegion(2259): Starting compaction of 812b4480b089b56a87a7dec53ca31d1a/family2 in testMajorCompactionFromAdmin,2,1699851356777.812b4480b089b56a87a7dec53ca31d1a. 2023-11-13 04:56:09,056 INFO [Listener at localhost/34517] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family2/b114e07e4a5f4a298779a115a86e2ffd, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family2/ba4a3c9c920840ad80a404e2d5475197, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family2/b4de18e1e8e54877948bcb5aca0e9196, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family2/0df6871fb6634910b36a0e0b95b1a578, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family2/b330732ea1a746739b51a97c0658481f] into tmpdir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/.tmp, totalSize=25.4 K 2023-11-13 04:56:09,057 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting b114e07e4a5f4a298779a115a86e2ffd, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699851358921 2023-11-13 04:56:09,057 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting ba4a3c9c920840ad80a404e2d5475197, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699851359584 2023-11-13 04:56:09,058 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting b4de18e1e8e54877948bcb5aca0e9196, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699851361446 2023-11-13 04:56:09,058 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 0df6871fb6634910b36a0e0b95b1a578, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699851362922 2023-11-13 04:56:09,058 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting b330732ea1a746739b51a97c0658481f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-13 04:56:09,066 INFO [Listener at localhost/34517] throttle.PressureAwareThroughputController(145): 812b4480b089b56a87a7dec53ca31d1a#family2#compaction#200 average throughput is 1.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-13 04:56:09,114 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family1/49c3e851b47f4fbcbfbf7f07fdd6e2b2, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family1/34b1558e458747b48b3844048308dede, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family1/faf038e7374f47f9a26260a649fbde2c, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family1/b60a1f637a7347209f1c825b5efb82d7, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family1/85ec853ace9f4160945ab1f59448c177] to archive 2023-11-13 04:56:09,115 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:56:09,117 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family1/49c3e851b47f4fbcbfbf7f07fdd6e2b2 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family1/49c3e851b47f4fbcbfbf7f07fdd6e2b2 2023-11-13 04:56:09,118 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family1/34b1558e458747b48b3844048308dede to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family1/34b1558e458747b48b3844048308dede 2023-11-13 04:56:09,119 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family1/faf038e7374f47f9a26260a649fbde2c to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family1/faf038e7374f47f9a26260a649fbde2c 2023-11-13 04:56:09,120 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family1/b60a1f637a7347209f1c825b5efb82d7 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family1/b60a1f637a7347209f1c825b5efb82d7 2023-11-13 04:56:09,121 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family1/85ec853ace9f4160945ab1f59448c177 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family1/85ec853ace9f4160945ab1f59448c177 2023-11-13 04:56:09,474 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231113659302f370f14518b8ed7b9f992a65d0_del 2023-11-13 04:56:09,474 INFO [Listener at localhost/34517] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231113659302f370f14518b8ed7b9f992a65d0_del to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231113659302f370f14518b8ed7b9f992a65d0_del 2023-11-13 04:56:10,287 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3570226efcad4414b7e646c07a474075 2023-11-13 04:56:10,288 DEBUG [Listener at localhost/34517] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/.tmp/family2/3570226efcad4414b7e646c07a474075 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family2/3570226efcad4414b7e646c07a474075 2023-11-13 04:56:10,291 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3570226efcad4414b7e646c07a474075 2023-11-13 04:56:10,292 INFO [Listener at localhost/34517] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 812b4480b089b56a87a7dec53ca31d1a/family2 of 812b4480b089b56a87a7dec53ca31d1a into 3570226efcad4414b7e646c07a474075(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-13 04:56:10,292 DEBUG [Listener at localhost/34517] regionserver.HRegion(2289): Compaction status journal for 812b4480b089b56a87a7dec53ca31d1a: 2023-11-13 04:56:10,292 DEBUG [Listener at localhost/34517] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-13 04:56:10,292 DEBUG [Listener at localhost/34517] regionserver.HStore(1912): f692c4768bba87d4f27f89747545abab/family1 is initiating major compaction (all files) 2023-11-13 04:56:10,292 INFO [Listener at localhost/34517] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-13 04:56:10,292 INFO [Listener at localhost/34517] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-13 04:56:10,292 INFO [Listener at localhost/34517] regionserver.HRegion(2259): Starting compaction of f692c4768bba87d4f27f89747545abab/family1 in testMajorCompactionFromAdmin,1,1699851356777.f692c4768bba87d4f27f89747545abab. 2023-11-13 04:56:10,292 INFO [Listener at localhost/34517] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family1/f7cc1b10ff75432c94923a45eb2910d7, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family1/5360c3c2d8f748e2a5a743ee0aaff9d5, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family1/39a4ed5337584280be0a4431aa3fb2bb, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family1/556c2fed756f4767bd345fb4b87ae540, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family1/2cd4a0d624a94f62bb077ce52547e335] into tmpdir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/.tmp, totalSize=27.1 K 2023-11-13 04:56:10,293 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting f7cc1b10ff75432c94923a45eb2910d7, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699851358921 2023-11-13 04:56:10,293 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 5360c3c2d8f748e2a5a743ee0aaff9d5, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699851359584 2023-11-13 04:56:10,294 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 39a4ed5337584280be0a4431aa3fb2bb, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699851361446 2023-11-13 04:56:10,294 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 556c2fed756f4767bd345fb4b87ae540, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699851362922 2023-11-13 04:56:10,294 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 2cd4a0d624a94f62bb077ce52547e335, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-13 04:56:10,301 INFO [Listener at localhost/34517] throttle.PressureAwareThroughputController(145): f692c4768bba87d4f27f89747545abab#family1#compaction#201 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-13 04:56:10,316 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family2/b114e07e4a5f4a298779a115a86e2ffd, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family2/ba4a3c9c920840ad80a404e2d5475197, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family2/b4de18e1e8e54877948bcb5aca0e9196, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family2/0df6871fb6634910b36a0e0b95b1a578, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family2/b330732ea1a746739b51a97c0658481f] to archive 2023-11-13 04:56:10,317 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:56:10,318 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family2/b114e07e4a5f4a298779a115a86e2ffd to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family2/b114e07e4a5f4a298779a115a86e2ffd 2023-11-13 04:56:10,319 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family2/ba4a3c9c920840ad80a404e2d5475197 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family2/ba4a3c9c920840ad80a404e2d5475197 2023-11-13 04:56:10,320 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family2/b4de18e1e8e54877948bcb5aca0e9196 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family2/b4de18e1e8e54877948bcb5aca0e9196 2023-11-13 04:56:10,321 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family2/0df6871fb6634910b36a0e0b95b1a578 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family2/0df6871fb6634910b36a0e0b95b1a578 2023-11-13 04:56:10,323 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family2/b330732ea1a746739b51a97c0658481f to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family2/b330732ea1a746739b51a97c0658481f 2023-11-13 04:56:10,344 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231113f2d0c92d3e93402fa0325d41bc34fd06_del 2023-11-13 04:56:10,344 INFO [Listener at localhost/34517] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231113f2d0c92d3e93402fa0325d41bc34fd06_del to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231113f2d0c92d3e93402fa0325d41bc34fd06_del 2023-11-13 04:56:11,197 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e6f2a725cd3347a6a3a61838f4ab511c 2023-11-13 04:56:11,197 DEBUG [Listener at localhost/34517] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/.tmp/family1/e6f2a725cd3347a6a3a61838f4ab511c as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family1/e6f2a725cd3347a6a3a61838f4ab511c 2023-11-13 04:56:11,219 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e6f2a725cd3347a6a3a61838f4ab511c 2023-11-13 04:56:11,220 INFO [Listener at localhost/34517] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in f692c4768bba87d4f27f89747545abab/family1 of f692c4768bba87d4f27f89747545abab into e6f2a725cd3347a6a3a61838f4ab511c(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-13 04:56:11,220 DEBUG [Listener at localhost/34517] regionserver.HRegion(2289): Compaction status journal for f692c4768bba87d4f27f89747545abab: 2023-11-13 04:56:11,220 DEBUG [Listener at localhost/34517] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-13 04:56:11,220 DEBUG [Listener at localhost/34517] regionserver.HStore(1912): f692c4768bba87d4f27f89747545abab/family2 is initiating major compaction (all files) 2023-11-13 04:56:11,220 INFO [Listener at localhost/34517] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-13 04:56:11,220 INFO [Listener at localhost/34517] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-13 04:56:11,220 INFO [Listener at localhost/34517] regionserver.HRegion(2259): Starting compaction of f692c4768bba87d4f27f89747545abab/family2 in testMajorCompactionFromAdmin,1,1699851356777.f692c4768bba87d4f27f89747545abab. 2023-11-13 04:56:11,220 INFO [Listener at localhost/34517] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family2/83e1da595baa4a9db251d9e8c33904eb, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family2/2fa0dadcd098488b851609066c401e9f, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family2/eb9e51bd68ca4847a968b1f749e5bffd, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family2/73d717ec61bc432d990dce52931ab522, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family2/df50e80b05504877903fca1b9724b6a2] into tmpdir=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/.tmp, totalSize=25.4 K 2023-11-13 04:56:11,221 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 83e1da595baa4a9db251d9e8c33904eb, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699851358921 2023-11-13 04:56:11,221 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 2fa0dadcd098488b851609066c401e9f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699851359584 2023-11-13 04:56:11,221 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting eb9e51bd68ca4847a968b1f749e5bffd, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699851361446 2023-11-13 04:56:11,222 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting 73d717ec61bc432d990dce52931ab522, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699851362922 2023-11-13 04:56:11,222 DEBUG [Listener at localhost/34517] compactions.Compactor(207): Compacting df50e80b05504877903fca1b9724b6a2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-13 04:56:11,223 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family1/f7cc1b10ff75432c94923a45eb2910d7, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family1/5360c3c2d8f748e2a5a743ee0aaff9d5, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family1/39a4ed5337584280be0a4431aa3fb2bb, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family1/556c2fed756f4767bd345fb4b87ae540, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family1/2cd4a0d624a94f62bb077ce52547e335] to archive 2023-11-13 04:56:11,224 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:56:11,226 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family1/f7cc1b10ff75432c94923a45eb2910d7 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family1/f7cc1b10ff75432c94923a45eb2910d7 2023-11-13 04:56:11,227 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family1/5360c3c2d8f748e2a5a743ee0aaff9d5 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family1/5360c3c2d8f748e2a5a743ee0aaff9d5 2023-11-13 04:56:11,228 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family1/39a4ed5337584280be0a4431aa3fb2bb to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family1/39a4ed5337584280be0a4431aa3fb2bb 2023-11-13 04:56:11,229 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family1/556c2fed756f4767bd345fb4b87ae540 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family1/556c2fed756f4767bd345fb4b87ae540 2023-11-13 04:56:11,230 INFO [Listener at localhost/34517] throttle.PressureAwareThroughputController(145): f692c4768bba87d4f27f89747545abab#family2#compaction#202 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-13 04:56:11,231 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family1/2cd4a0d624a94f62bb077ce52547e335 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family1/2cd4a0d624a94f62bb077ce52547e335 2023-11-13 04:56:11,637 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202311137d7e7ace0d904a6bbdcf7593308a06ae_del 2023-11-13 04:56:11,637 INFO [Listener at localhost/34517] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311137d7e7ace0d904a6bbdcf7593308a06ae_del to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202311137d7e7ace0d904a6bbdcf7593308a06ae_del 2023-11-13 04:56:12,450 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f3541702dc1b4be59e9ecb28fe574566 2023-11-13 04:56:12,451 DEBUG [Listener at localhost/34517] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/.tmp/family2/f3541702dc1b4be59e9ecb28fe574566 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family2/f3541702dc1b4be59e9ecb28fe574566 2023-11-13 04:56:12,454 INFO [Listener at localhost/34517] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f3541702dc1b4be59e9ecb28fe574566 2023-11-13 04:56:12,455 INFO [Listener at localhost/34517] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in f692c4768bba87d4f27f89747545abab/family2 of f692c4768bba87d4f27f89747545abab into f3541702dc1b4be59e9ecb28fe574566(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-13 04:56:12,455 DEBUG [Listener at localhost/34517] regionserver.HRegion(2289): Compaction status journal for f692c4768bba87d4f27f89747545abab: 2023-11-13 04:56:12,458 DEBUG [Listener at localhost/34517] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-13 04:56:12,461 DEBUG [Listener at localhost/34517] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-13 04:56:12,464 DEBUG [Listener at localhost/34517] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-13 04:56:12,464 DEBUG [Listener at localhost/34517] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-13 04:56:12,468 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33831] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10 -r\xCB(\xED\x06\x14\xB7F\xBD\xBFU\xAAW."\x10\xC3S\x13\xBA\x9C1\x04\x85\x85\xCB~\xA8\x9E:\xFA\x0F*\x10j\xC9=\xE8j\xC3\x9F\x0C\xC8\xF1\xDC\x17\xB1\xAF\x1Fr2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-11-13 04:56:12,489 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] procedure2.ProcedureExecutor(1028): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-13 04:56:12,490 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-13 04:56:12,490 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-13 04:56:12,490 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699851972490 2023-11-13 04:56:12,491 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-13 04:56:12,514 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family2/83e1da595baa4a9db251d9e8c33904eb, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family2/2fa0dadcd098488b851609066c401e9f, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family2/eb9e51bd68ca4847a968b1f749e5bffd, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family2/73d717ec61bc432d990dce52931ab522, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family2/df50e80b05504877903fca1b9724b6a2] to archive 2023-11-13 04:56:12,515 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:56:12,516 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family2/83e1da595baa4a9db251d9e8c33904eb to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family2/83e1da595baa4a9db251d9e8c33904eb 2023-11-13 04:56:12,517 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family2/2fa0dadcd098488b851609066c401e9f to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family2/2fa0dadcd098488b851609066c401e9f 2023-11-13 04:56:12,518 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family2/eb9e51bd68ca4847a968b1f749e5bffd to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family2/eb9e51bd68ca4847a968b1f749e5bffd 2023-11-13 04:56:12,519 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family2/73d717ec61bc432d990dce52931ab522 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family2/73d717ec61bc432d990dce52931ab522 2023-11-13 04:56:12,520 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family2/df50e80b05504877903fca1b9724b6a2 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family2/df50e80b05504877903fca1b9724b6a2 2023-11-13 04:56:12,796 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-11-13 04:56:12,818 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023111320433e8c98ab49128f8e0d4e3cc534d4_del 2023-11-13 04:56:12,840 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231113f2d0c92d3e93402fa0325d41bc34fd06_del 2023-11-13 04:56:12,861 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023111398ade9ad0b23485a98bb766bcdd6d6c7_del 2023-11-13 04:56:12,861 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-11-13 04:56:12,861 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] zookeeper.ReadOnlyZKClient(139): Connect 0x05cfc98a to 127.0.0.1:51072 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-13 04:56:12,866 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2e830e67, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-13 04:56:12,866 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231113 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-13 04:56:13,417 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111381d47954482a4fd092d1d03c5c7bd8c0 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023111381d47954482a4fd092d1d03c5c7bd8c0 2023-11-13 04:56:13,417 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231113 table='testMajorCompactionFromAdmin' column='family1' 2023-11-13 04:56:13,428 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-13 04:56:13,430 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47890, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-13 04:56:13,435 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-13 04:56:13,437 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43302, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-13 04:56:13,463 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231113/family1/3b0d53f2bb56403baf91064083f55fe3 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-11-13 04:56:13,464 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,2,1699851356777.812b4480b089b56a87a7dec53ca31d1a., hostname=jenkins-hbase4.apache.org,41657,1699851201532, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231113/family1/3b0d53f2bb56403baf91064083f55fe3}] 2023-11-13 04:56:13,468 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(763): Validating hfile at hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231113/family1/3b0d53f2bb56403baf91064083f55fe3 for inclusion in 812b4480b089b56a87a7dec53ca31d1a/family1 2023-11-13 04:56:13,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-11-13 04:56:13,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-13 04:56:13,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HRegion(2446): Flush status journal for 812b4480b089b56a87a7dec53ca31d1a: 2023-11-13 04:56:13,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231113/family1/3b0d53f2bb56403baf91064083f55fe3 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionFromAdmin__rorj1o0cm8pvihbp83ags4e1ml0ft0iouccdficoo1f0kkhnnerdqbg55ikap97j/family1/3b0d53f2bb56403baf91064083f55fe3 2023-11-13 04:56:13,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionFromAdmin__rorj1o0cm8pvihbp83ags4e1ml0ft0iouccdficoo1f0kkhnnerdqbg55ikap97j/family1/3b0d53f2bb56403baf91064083f55fe3 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family1/6c0dba147f8d426ca4344e29afbf5e74_SeqId_28_ 2023-11-13 04:56:13,491 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(849): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionFromAdmin__rorj1o0cm8pvihbp83ags4e1ml0ft0iouccdficoo1f0kkhnnerdqbg55ikap97j/family1/3b0d53f2bb56403baf91064083f55fe3 into 812b4480b089b56a87a7dec53ca31d1a/family1 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family1/6c0dba147f8d426ca4344e29afbf5e74_SeqId_28_ - updating store file list. 2023-11-13 04:56:13,512 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(882): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family1/6c0dba147f8d426ca4344e29afbf5e74_SeqId_28_ into 812b4480b089b56a87a7dec53ca31d1a/family1 2023-11-13 04:56:13,512 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(855): Successfully loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionFromAdmin__rorj1o0cm8pvihbp83ags4e1ml0ft0iouccdficoo1f0kkhnnerdqbg55ikap97j/family1/3b0d53f2bb56403baf91064083f55fe3 into 812b4480b089b56a87a7dec53ca31d1a/family1 (new location: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/family1/6c0dba147f8d426ca4344e29afbf5e74_SeqId_28_) 2023-11-13 04:56:13,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionFromAdmin__rorj1o0cm8pvihbp83ags4e1ml0ft0iouccdficoo1f0kkhnnerdqbg55ikap97j/family1/3b0d53f2bb56403baf91064083f55fe3 2023-11-13 04:56:13,514 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231113 table='testMajorCompactionFromAdmin' column='family1' 2023-11-13 04:56:13,515 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:56:13,516 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023111347d66fefa9b941cf939b94f2e82fbf19 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023111347d66fefa9b941cf939b94f2e82fbf19 2023-11-13 04:56:13,517 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023111389b5256b0a714f1c9e884958335af72d to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023111389b5256b0a714f1c9e884958335af72d 2023-11-13 04:56:13,518 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231113f48b4960e19442e88503d31c86030503 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231113f48b4960e19442e88503d31c86030503 2023-11-13 04:56:13,519 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231113f7933e0ded204c058b9431a3e7ec4cb8 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231113f7933e0ded204c058b9431a3e7ec4cb8 2023-11-13 04:56:13,520 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-13 04:56:13,520 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231113' 2023-11-13 04:56:13,520 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231113 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-13 04:56:13,520 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231113 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-13 04:56:13,687 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311137408c7e3946f4054a714b95253b28bcf to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311137408c7e3946f4054a714b95253b28bcf 2023-11-13 04:56:13,688 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231113 table='testMajorCompactionFromAdmin' column='family1' 2023-11-13 04:56:13,741 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231113/family1/60282b74ac5a4f72b31a5c6725ea5d21 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-11-13 04:56:13,742 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,1,1699851356777.f692c4768bba87d4f27f89747545abab., hostname=jenkins-hbase4.apache.org,41657,1699851201532, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231113/family1/60282b74ac5a4f72b31a5c6725ea5d21}] 2023-11-13 04:56:13,744 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(763): Validating hfile at hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231113/family1/60282b74ac5a4f72b31a5c6725ea5d21 for inclusion in f692c4768bba87d4f27f89747545abab/family1 2023-11-13 04:56:13,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-11-13 04:56:13,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-13 04:56:13,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HRegion(2446): Flush status journal for f692c4768bba87d4f27f89747545abab: 2023-11-13 04:56:13,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231113/family1/60282b74ac5a4f72b31a5c6725ea5d21 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionFromAdmin__2n0equv632m5n35shkf9bm28o1admes5s9u7v0qdhsj0is2nc91uklplglnjedav/family1/60282b74ac5a4f72b31a5c6725ea5d21 2023-11-13 04:56:13,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionFromAdmin__2n0equv632m5n35shkf9bm28o1admes5s9u7v0qdhsj0is2nc91uklplglnjedav/family1/60282b74ac5a4f72b31a5c6725ea5d21 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family1/0aa1dabed19544dbb2146911772508ca_SeqId_28_ 2023-11-13 04:56:13,773 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(849): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionFromAdmin__2n0equv632m5n35shkf9bm28o1admes5s9u7v0qdhsj0is2nc91uklplglnjedav/family1/60282b74ac5a4f72b31a5c6725ea5d21 into f692c4768bba87d4f27f89747545abab/family1 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family1/0aa1dabed19544dbb2146911772508ca_SeqId_28_ - updating store file list. 2023-11-13 04:56:13,794 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(882): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family1/0aa1dabed19544dbb2146911772508ca_SeqId_28_ into f692c4768bba87d4f27f89747545abab/family1 2023-11-13 04:56:13,794 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(855): Successfully loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionFromAdmin__2n0equv632m5n35shkf9bm28o1admes5s9u7v0qdhsj0is2nc91uklplglnjedav/family1/60282b74ac5a4f72b31a5c6725ea5d21 into f692c4768bba87d4f27f89747545abab/family1 (new location: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/family1/0aa1dabed19544dbb2146911772508ca_SeqId_28_) 2023-11-13 04:56:13,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionFromAdmin__2n0equv632m5n35shkf9bm28o1admes5s9u7v0qdhsj0is2nc91uklplglnjedav/family1/60282b74ac5a4f72b31a5c6725ea5d21 2023-11-13 04:56:13,796 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231113 table='testMajorCompactionFromAdmin' column='family1' 2023-11-13 04:56:13,797 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:56:13,798 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311130a6df6c573d24b83b115742d46db49ea to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311130a6df6c573d24b83b115742d46db49ea 2023-11-13 04:56:13,799 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311132907a89ebc9c4ed886090ad4f5872224 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311132907a89ebc9c4ed886090ad4f5872224 2023-11-13 04:56:13,799 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311136eeebf627a794f6281d668ce14da651e to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311136eeebf627a794f6281d668ce14da651e 2023-11-13 04:56:13,800 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231113da061b26bbdd4e6cb2d7bb167656417a to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231113da061b26bbdd4e6cb2d7bb167656417a 2023-11-13 04:56:13,800 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-13 04:56:13,800 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231113' 2023-11-13 04:56:13,800 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231113 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-13 04:56:13,801 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231113 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-13 04:56:14,743 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231113442e5a1c8e974b8abfc6d2bdbf6e267b to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231113442e5a1c8e974b8abfc6d2bdbf6e267b 2023-11-13 04:56:14,744 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231113 table='testMajorCompactionFromAdmin' column='family1' 2023-11-13 04:56:14,788 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231113/family1/43b46b875a0745dba1275219c65136a5 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-11-13 04:56:14,789 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,,1699851356777.88c06180dda7a041f01d4b128564bf13., hostname=jenkins-hbase4.apache.org,41657,1699851201532, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231113/family1/43b46b875a0745dba1275219c65136a5}] 2023-11-13 04:56:14,790 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(763): Validating hfile at hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231113/family1/43b46b875a0745dba1275219c65136a5 for inclusion in 88c06180dda7a041f01d4b128564bf13/family1 2023-11-13 04:56:14,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-11-13 04:56:14,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(777): Region bounds: first= last=1 2023-11-13 04:56:14,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HRegion(2446): Flush status journal for 88c06180dda7a041f01d4b128564bf13: 2023-11-13 04:56:14,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231113/family1/43b46b875a0745dba1275219c65136a5 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionFromAdmin__jstocuati9s3ujq1hd16ovtq3blksfbbmmopa4tt0bd67qr30pki6f6dlatccrrm/family1/43b46b875a0745dba1275219c65136a5 2023-11-13 04:56:14,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionFromAdmin__jstocuati9s3ujq1hd16ovtq3blksfbbmmopa4tt0bd67qr30pki6f6dlatccrrm/family1/43b46b875a0745dba1275219c65136a5 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family1/7d570f2388c745898bf649309d755656_SeqId_28_ 2023-11-13 04:56:14,814 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(849): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionFromAdmin__jstocuati9s3ujq1hd16ovtq3blksfbbmmopa4tt0bd67qr30pki6f6dlatccrrm/family1/43b46b875a0745dba1275219c65136a5 into 88c06180dda7a041f01d4b128564bf13/family1 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family1/7d570f2388c745898bf649309d755656_SeqId_28_ - updating store file list. 2023-11-13 04:56:14,834 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(882): Loaded HFile hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family1/7d570f2388c745898bf649309d755656_SeqId_28_ into 88c06180dda7a041f01d4b128564bf13/family1 2023-11-13 04:56:14,834 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.HStore(855): Successfully loaded hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionFromAdmin__jstocuati9s3ujq1hd16ovtq3blksfbbmmopa4tt0bd67qr30pki6f6dlatccrrm/family1/43b46b875a0745dba1275219c65136a5 into 88c06180dda7a041f01d4b128564bf13/family1 (new location: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/family1/7d570f2388c745898bf649309d755656_SeqId_28_) 2023-11-13 04:56:14,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41657] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/staging/jenkins__testMajorCompactionFromAdmin__jstocuati9s3ujq1hd16ovtq3blksfbbmmopa4tt0bd67qr30pki6f6dlatccrrm/family1/43b46b875a0745dba1275219c65136a5 2023-11-13 04:56:14,836 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231113 table='testMajorCompactionFromAdmin' column='family1' 2023-11-13 04:56:14,836 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:56:14,837 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311134e4b7465eef84cb0a3814a75ffba0223 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311134e4b7465eef84cb0a3814a75ffba0223 2023-11-13 04:56:14,838 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311137d89b4ba49504559a2844f6610d453c3 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311137d89b4ba49504559a2844f6610d453c3 2023-11-13 04:56:14,839 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023111386f826c83e1044369399fec3ecc19ebb to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023111386f826c83e1044369399fec3ecc19ebb 2023-11-13 04:56:14,840 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231113f0ebbc65e3de41208fe46dd33ac47da2 to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231113f0ebbc65e3de41208fe46dd33ac47da2 2023-11-13 04:56:14,840 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-13 04:56:14,840 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231113' 2023-11-13 04:56:14,841 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231113 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-13 04:56:14,841 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-11-13 04:56:14,841 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-13 04:56:14,841 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(367): [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023111320433e8c98ab49128f8e0d4e3cc534d4_del] 2023-11-13 04:56:14,841 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:56:14,842 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023111320433e8c98ab49128f8e0d4e3cc534d4_del to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023111320433e8c98ab49128f8e0d4e3cc534d4_del 2023-11-13 04:56:14,843 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-13 04:56:14,843 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(367): [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231113f2d0c92d3e93402fa0325d41bc34fd06_del] 2023-11-13 04:56:14,843 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:56:14,844 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231113f2d0c92d3e93402fa0325d41bc34fd06_del to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231113f2d0c92d3e93402fa0325d41bc34fd06_del 2023-11-13 04:56:14,844 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-13 04:56:14,844 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] compactions.PartitionedMobCompactor(367): [hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023111398ade9ad0b23485a98bb766bcdd6d6c7_del] 2023-11-13 04:56:14,845 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] backup.HFileArchiver(360): Archiving compacted files. 2023-11-13 04:56:14,846 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023111398ade9ad0b23485a98bb766bcdd6d6c7_del to hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023111398ade9ad0b23485a98bb766bcdd6d6c7_del 2023-11-13 04:56:14,846 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-13 04:56:14,846 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699851204172] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-13 04:56:14,847 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-13 04:56:14,849 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 2.3590 sec 2023-11-13 04:56:14,864 DEBUG [Listener at localhost/34517] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-13 04:56:14,866 DEBUG [Listener at localhost/34517] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-13 04:56:14,868 DEBUG [Listener at localhost/34517] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-13 04:56:14,869 DEBUG [Listener at localhost/34517] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-13 04:56:14,873 INFO [Listener at localhost/34517] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-13 04:56:14,907 INFO [Listener at localhost/34517] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=250 (was 262), OpenFileDescriptor=674 (was 683), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=128 (was 119) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=2822 (was 2835) 2023-11-13 04:56:14,907 DEBUG [Listener at localhost/34517] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x65c25ebc to 127.0.0.1:51072 2023-11-13 04:56:14,908 DEBUG [Listener at localhost/34517] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-13 04:56:14,908 INFO [Listener at localhost/34517] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-11-13 04:56:14,908 INFO [Listener at localhost/34517] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-13 04:56:14,908 DEBUG [Listener at localhost/34517] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x36d9c5a6 to 127.0.0.1:51072 2023-11-13 04:56:14,908 DEBUG [Listener at localhost/34517] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-13 04:56:14,908 DEBUG [Listener at localhost/34517] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-11-13 04:56:14,908 DEBUG [Listener at localhost/34517] util.JVMClusterUtil(257): Found active master hash=1175466482, stopped=false 2023-11-13 04:56:14,908 INFO [Listener at localhost/34517] master.ServerManager(888): Cluster shutdown requested of master=jenkins-hbase4.apache.org,33831,1699851200322 2023-11-13 04:56:14,910 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-11-13 04:56:14,910 INFO [Listener at localhost/34517] procedure2.ProcedureExecutor(628): Stopping 2023-11-13 04:56:14,910 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-11-13 04:56:14,911 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-13 04:56:14,911 DEBUG [Listener at localhost/34517] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x29ce2801 to 127.0.0.1:51072 2023-11-13 04:56:14,911 DEBUG [Listener at localhost/34517] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-13 04:56:14,911 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-13 04:56:14,911 INFO [Listener at localhost/34517] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,41657,1699851201532' ***** 2023-11-13 04:56:14,911 INFO [Listener at localhost/34517] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-11-13 04:56:14,911 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-13 04:56:14,911 INFO [RS:0;jenkins-hbase4:41657] regionserver.HeapMemoryManager(220): Stopping 2023-11-13 04:56:14,912 INFO [RS:0;jenkins-hbase4:41657] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-11-13 04:56:14,912 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-11-13 04:56:14,912 INFO [RS:0;jenkins-hbase4:41657] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-11-13 04:56:14,912 INFO [RS:0;jenkins-hbase4:41657] regionserver.HRegionServer(3305): Received CLOSE for beccf4b9bb7f1b9d4214b816ec12c591 2023-11-13 04:56:14,912 INFO [RS:0;jenkins-hbase4:41657] regionserver.HRegionServer(3305): Received CLOSE for 88c06180dda7a041f01d4b128564bf13 2023-11-13 04:56:14,912 INFO [RS:0;jenkins-hbase4:41657] regionserver.HRegionServer(3305): Received CLOSE for d39756ba701219092d4f35836804d315 2023-11-13 04:56:14,912 INFO [RS:0;jenkins-hbase4:41657] regionserver.HRegionServer(3305): Received CLOSE for eab65722ecb84f0f65e150d916e14807 2023-11-13 04:56:14,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing beccf4b9bb7f1b9d4214b816ec12c591, disabling compactions & flushes 2023-11-13 04:56:14,912 INFO [RS:0;jenkins-hbase4:41657] regionserver.HRegionServer(3305): Received CLOSE for b407be211f78e6f863b566bf7b56412d 2023-11-13 04:56:14,912 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1699851325657.beccf4b9bb7f1b9d4214b816ec12c591. 2023-11-13 04:56:14,912 INFO [RS:0;jenkins-hbase4:41657] regionserver.HRegionServer(3305): Received CLOSE for 636529c4d3fc4ed9b0aa1a1d0c8a802d 2023-11-13 04:56:14,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1699851325657.beccf4b9bb7f1b9d4214b816ec12c591. 2023-11-13 04:56:14,913 INFO [RS:0;jenkins-hbase4:41657] regionserver.HRegionServer(3305): Received CLOSE for 69269bc0d44ad4030e108151ca591d2f 2023-11-13 04:56:14,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1699851325657.beccf4b9bb7f1b9d4214b816ec12c591. after waiting 0 ms 2023-11-13 04:56:14,913 INFO [RS:0;jenkins-hbase4:41657] regionserver.HRegionServer(3305): Received CLOSE for ce3aa54af75e8a2d70418cb3df223e32 2023-11-13 04:56:14,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1699851325657.beccf4b9bb7f1b9d4214b816ec12c591. 2023-11-13 04:56:14,913 INFO [RS:0;jenkins-hbase4:41657] regionserver.HRegionServer(3305): Received CLOSE for bfeed2e88ce202cf921374d6d67968c7 2023-11-13 04:56:14,913 INFO [RS:0;jenkins-hbase4:41657] regionserver.HRegionServer(3305): Received CLOSE for 6638aa08a24bc6e34e9840c49e638c8a 2023-11-13 04:56:14,913 INFO [RS:0;jenkins-hbase4:41657] regionserver.HRegionServer(3305): Received CLOSE for 93b1e59720a53a032a804bf4ec0ce192 2023-11-13 04:56:14,913 INFO [RS:0;jenkins-hbase4:41657] regionserver.HRegionServer(3305): Received CLOSE for 27cb223f9866bdc4989cc22b2513873e 2023-11-13 04:56:14,913 INFO [RS:0;jenkins-hbase4:41657] regionserver.HRegionServer(3305): Received CLOSE for e04c69bd7378d342c6ee08c3af87ad84 2023-11-13 04:56:14,913 INFO [RS:0;jenkins-hbase4:41657] regionserver.HRegionServer(3305): Received CLOSE for b118e2043963096bdb82baf7b4023e66 2023-11-13 04:56:14,913 INFO [RS:0;jenkins-hbase4:41657] regionserver.HRegionServer(3305): Received CLOSE for e13efa47a2338bfc8c25006e697a36d8 2023-11-13 04:56:14,913 INFO [RS:0;jenkins-hbase4:41657] regionserver.HRegionServer(3305): Received CLOSE for 812b4480b089b56a87a7dec53ca31d1a 2023-11-13 04:56:14,913 INFO [RS:0;jenkins-hbase4:41657] regionserver.HRegionServer(3305): Received CLOSE for f692c4768bba87d4f27f89747545abab 2023-11-13 04:56:14,913 INFO [RS:0;jenkins-hbase4:41657] regionserver.HRegionServer(3305): Received CLOSE for e238262ff621754c018596b9ec849ffa 2023-11-13 04:56:14,913 INFO [RS:0;jenkins-hbase4:41657] regionserver.HRegionServer(3305): Received CLOSE for 65bf1eecde5a83e1bebe47c93d288912 2023-11-13 04:56:14,913 INFO [RS:0;jenkins-hbase4:41657] regionserver.HRegionServer(3305): Received CLOSE for 90df22d5e18546f877e84e0c244138f5 2023-11-13 04:56:14,913 INFO [RS:0;jenkins-hbase4:41657] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:14,913 DEBUG [RS:0;jenkins-hbase4:41657] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x320de6d4 to 127.0.0.1:51072 2023-11-13 04:56:14,913 DEBUG [RS:0;jenkins-hbase4:41657] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-13 04:56:14,914 INFO [RS:0;jenkins-hbase4:41657] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-11-13 04:56:14,914 INFO [RS:0;jenkins-hbase4:41657] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-11-13 04:56:14,914 INFO [RS:0;jenkins-hbase4:41657] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-11-13 04:56:14,914 INFO [RS:0;jenkins-hbase4:41657] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-11-13 04:56:14,914 INFO [RS:0;jenkins-hbase4:41657] regionserver.HRegionServer(1474): Waiting on 21 regions to close 2023-11-13 04:56:14,914 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-11-13 04:56:14,914 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-11-13 04:56:14,914 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-11-13 04:56:14,914 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-11-13 04:56:14,914 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-11-13 04:56:14,915 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=50.56 KB heapSize=78.23 KB 2023-11-13 04:56:14,915 DEBUG [RS:0;jenkins-hbase4:41657] regionserver.HRegionServer(1504): Waiting on 1588230740, 27cb223f9866bdc4989cc22b2513873e, 636529c4d3fc4ed9b0aa1a1d0c8a802d, 65bf1eecde5a83e1bebe47c93d288912, 6638aa08a24bc6e34e9840c49e638c8a, 69269bc0d44ad4030e108151ca591d2f, 812b4480b089b56a87a7dec53ca31d1a, 88c06180dda7a041f01d4b128564bf13, 90df22d5e18546f877e84e0c244138f5, 93b1e59720a53a032a804bf4ec0ce192, b118e2043963096bdb82baf7b4023e66, b407be211f78e6f863b566bf7b56412d, beccf4b9bb7f1b9d4214b816ec12c591, bfeed2e88ce202cf921374d6d67968c7, ce3aa54af75e8a2d70418cb3df223e32, d39756ba701219092d4f35836804d315, e04c69bd7378d342c6ee08c3af87ad84, e13efa47a2338bfc8c25006e697a36d8, e238262ff621754c018596b9ec849ffa, eab65722ecb84f0f65e150d916e14807, f692c4768bba87d4f27f89747545abab 2023-11-13 04:56:14,916 INFO [regionserver/jenkins-hbase4:0.Chore.2] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-11-13 04:56:14,917 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/beccf4b9bb7f1b9d4214b816ec12c591/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-13 04:56:14,918 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1699851325657.beccf4b9bb7f1b9d4214b816ec12c591. 2023-11-13 04:56:14,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for beccf4b9bb7f1b9d4214b816ec12c591: 2023-11-13 04:56:14,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1699851325657.beccf4b9bb7f1b9d4214b816ec12c591. 2023-11-13 04:56:14,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 88c06180dda7a041f01d4b128564bf13, disabling compactions & flushes 2023-11-13 04:56:14,918 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1699851356777.88c06180dda7a041f01d4b128564bf13. 2023-11-13 04:56:14,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1699851356777.88c06180dda7a041f01d4b128564bf13. 2023-11-13 04:56:14,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1699851356777.88c06180dda7a041f01d4b128564bf13. after waiting 0 ms 2023-11-13 04:56:14,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1699851356777.88c06180dda7a041f01d4b128564bf13. 2023-11-13 04:56:14,923 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.28 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/hbase/meta/1588230740/.tmp/info/72d3888074f74906b3fa619b70ba4e8a 2023-11-13 04:56:14,924 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/88c06180dda7a041f01d4b128564bf13/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-13 04:56:14,925 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1699851356777.88c06180dda7a041f01d4b128564bf13. 2023-11-13 04:56:14,925 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 88c06180dda7a041f01d4b128564bf13: 2023-11-13 04:56:14,925 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1699851356777.88c06180dda7a041f01d4b128564bf13. 2023-11-13 04:56:14,925 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d39756ba701219092d4f35836804d315, disabling compactions & flushes 2023-11-13 04:56:14,925 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315. 2023-11-13 04:56:14,925 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315. 2023-11-13 04:56:14,925 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315. after waiting 0 ms 2023-11-13 04:56:14,925 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315. 2023-11-13 04:56:14,928 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 72d3888074f74906b3fa619b70ba4e8a 2023-11-13 04:56:14,928 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithMonthlyPolicy/d39756ba701219092d4f35836804d315/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-11-13 04:56:14,929 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315. 2023-11-13 04:56:14,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d39756ba701219092d4f35836804d315: 2023-11-13 04:56:14,930 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1699851344364.d39756ba701219092d4f35836804d315. 2023-11-13 04:56:14,930 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing eab65722ecb84f0f65e150d916e14807, disabling compactions & flushes 2023-11-13 04:56:14,930 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. 2023-11-13 04:56:14,930 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. 2023-11-13 04:56:14,930 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. after waiting 0 ms 2023-11-13 04:56:14,930 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. 2023-11-13 04:56:14,934 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/hbase/meta/1588230740/.tmp/rep_barrier/e2f13649626a4a33be9616d377030d1d 2023-11-13 04:56:14,934 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/eab65722ecb84f0f65e150d916e14807/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-11-13 04:56:14,935 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. 2023-11-13 04:56:14,935 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for eab65722ecb84f0f65e150d916e14807: 2023-11-13 04:56:14,935 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699851277517.eab65722ecb84f0f65e150d916e14807. 2023-11-13 04:56:14,936 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b407be211f78e6f863b566bf7b56412d, disabling compactions & flushes 2023-11-13 04:56:14,936 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1699851203458.b407be211f78e6f863b566bf7b56412d. 2023-11-13 04:56:14,936 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1699851203458.b407be211f78e6f863b566bf7b56412d. 2023-11-13 04:56:14,936 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1699851203458.b407be211f78e6f863b566bf7b56412d. after waiting 0 ms 2023-11-13 04:56:14,936 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1699851203458.b407be211f78e6f863b566bf7b56412d. 2023-11-13 04:56:14,936 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing b407be211f78e6f863b566bf7b56412d 1/1 column families, dataSize=109 B heapSize=592 B 2023-11-13 04:56:14,938 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e2f13649626a4a33be9616d377030d1d 2023-11-13 04:56:14,946 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/hbase/meta/1588230740/.tmp/table/c143b09e95c142e09457f59722b9fe31 2023-11-13 04:56:14,949 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c143b09e95c142e09457f59722b9fe31 2023-11-13 04:56:14,949 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/hbase/meta/1588230740/.tmp/info/72d3888074f74906b3fa619b70ba4e8a as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/hbase/meta/1588230740/info/72d3888074f74906b3fa619b70ba4e8a 2023-11-13 04:56:14,952 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 72d3888074f74906b3fa619b70ba4e8a 2023-11-13 04:56:14,952 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/hbase/meta/1588230740/info/72d3888074f74906b3fa619b70ba4e8a, entries=226, sequenceid=130, filesize=37.9 K 2023-11-13 04:56:14,953 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/hbase/meta/1588230740/.tmp/rep_barrier/e2f13649626a4a33be9616d377030d1d as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/hbase/meta/1588230740/rep_barrier/e2f13649626a4a33be9616d377030d1d 2023-11-13 04:56:14,956 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e2f13649626a4a33be9616d377030d1d 2023-11-13 04:56:14,956 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/hbase/meta/1588230740/rep_barrier/e2f13649626a4a33be9616d377030d1d, entries=1, sequenceid=130, filesize=5.0 K 2023-11-13 04:56:14,956 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/hbase/meta/1588230740/.tmp/table/c143b09e95c142e09457f59722b9fe31 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/hbase/meta/1588230740/table/c143b09e95c142e09457f59722b9fe31 2023-11-13 04:56:14,959 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c143b09e95c142e09457f59722b9fe31 2023-11-13 04:56:14,959 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/hbase/meta/1588230740/table/c143b09e95c142e09457f59722b9fe31, entries=27, sequenceid=130, filesize=6.6 K 2023-11-13 04:56:14,960 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~50.56 KB/51772, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 46ms, sequenceid=130, compaction requested=false 2023-11-13 04:56:14,963 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-11-13 04:56:14,963 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-11-13 04:56:14,964 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-11-13 04:56:14,964 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-11-13 04:56:14,964 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-11-13 04:56:14,974 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-11-13 04:56:15,115 DEBUG [RS:0;jenkins-hbase4:41657] regionserver.HRegionServer(1504): Waiting on 27cb223f9866bdc4989cc22b2513873e, 636529c4d3fc4ed9b0aa1a1d0c8a802d, 65bf1eecde5a83e1bebe47c93d288912, 6638aa08a24bc6e34e9840c49e638c8a, 69269bc0d44ad4030e108151ca591d2f, 812b4480b089b56a87a7dec53ca31d1a, 90df22d5e18546f877e84e0c244138f5, 93b1e59720a53a032a804bf4ec0ce192, b118e2043963096bdb82baf7b4023e66, b407be211f78e6f863b566bf7b56412d, bfeed2e88ce202cf921374d6d67968c7, ce3aa54af75e8a2d70418cb3df223e32, e04c69bd7378d342c6ee08c3af87ad84, e13efa47a2338bfc8c25006e697a36d8, e238262ff621754c018596b9ec849ffa, f692c4768bba87d4f27f89747545abab 2023-11-13 04:56:15,316 DEBUG [RS:0;jenkins-hbase4:41657] regionserver.HRegionServer(1504): Waiting on 27cb223f9866bdc4989cc22b2513873e, 636529c4d3fc4ed9b0aa1a1d0c8a802d, 65bf1eecde5a83e1bebe47c93d288912, 6638aa08a24bc6e34e9840c49e638c8a, 69269bc0d44ad4030e108151ca591d2f, 812b4480b089b56a87a7dec53ca31d1a, 90df22d5e18546f877e84e0c244138f5, 93b1e59720a53a032a804bf4ec0ce192, b118e2043963096bdb82baf7b4023e66, b407be211f78e6f863b566bf7b56412d, bfeed2e88ce202cf921374d6d67968c7, ce3aa54af75e8a2d70418cb3df223e32, e04c69bd7378d342c6ee08c3af87ad84, e13efa47a2338bfc8c25006e697a36d8, e238262ff621754c018596b9ec849ffa, f692c4768bba87d4f27f89747545abab 2023-11-13 04:56:15,342 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/hbase/namespace/b407be211f78e6f863b566bf7b56412d/.tmp/info/6ac033fec3a94f18bbbdba79a8abe4c9 2023-11-13 04:56:15,346 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/hbase/namespace/b407be211f78e6f863b566bf7b56412d/.tmp/info/6ac033fec3a94f18bbbdba79a8abe4c9 as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/hbase/namespace/b407be211f78e6f863b566bf7b56412d/info/6ac033fec3a94f18bbbdba79a8abe4c9 2023-11-13 04:56:15,349 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/hbase/namespace/b407be211f78e6f863b566bf7b56412d/info/6ac033fec3a94f18bbbdba79a8abe4c9, entries=3, sequenceid=7, filesize=4.8 K 2023-11-13 04:56:15,351 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for b407be211f78e6f863b566bf7b56412d in 415ms, sequenceid=7, compaction requested=false 2023-11-13 04:56:15,354 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/hbase/namespace/b407be211f78e6f863b566bf7b56412d/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-11-13 04:56:15,355 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1699851203458.b407be211f78e6f863b566bf7b56412d. 2023-11-13 04:56:15,355 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b407be211f78e6f863b566bf7b56412d: 2023-11-13 04:56:15,355 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1699851203458.b407be211f78e6f863b566bf7b56412d. 2023-11-13 04:56:15,355 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 636529c4d3fc4ed9b0aa1a1d0c8a802d, disabling compactions & flushes 2023-11-13 04:56:15,355 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d. 2023-11-13 04:56:15,355 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d. 2023-11-13 04:56:15,355 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d. after waiting 0 ms 2023-11-13 04:56:15,355 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d. 2023-11-13 04:56:15,358 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyPolicy/636529c4d3fc4ed9b0aa1a1d0c8a802d/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-13 04:56:15,359 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d. 2023-11-13 04:56:15,359 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 636529c4d3fc4ed9b0aa1a1d0c8a802d: 2023-11-13 04:56:15,359 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1699851247232.636529c4d3fc4ed9b0aa1a1d0c8a802d. 2023-11-13 04:56:15,359 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 69269bc0d44ad4030e108151ca591d2f, disabling compactions & flushes 2023-11-13 04:56:15,359 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1699851325657.69269bc0d44ad4030e108151ca591d2f. 2023-11-13 04:56:15,359 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1699851325657.69269bc0d44ad4030e108151ca591d2f. 2023-11-13 04:56:15,359 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1699851325657.69269bc0d44ad4030e108151ca591d2f. after waiting 0 ms 2023-11-13 04:56:15,359 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1699851325657.69269bc0d44ad4030e108151ca591d2f. 2023-11-13 04:56:15,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/69269bc0d44ad4030e108151ca591d2f/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-13 04:56:15,362 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1699851325657.69269bc0d44ad4030e108151ca591d2f. 2023-11-13 04:56:15,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 69269bc0d44ad4030e108151ca591d2f: 2023-11-13 04:56:15,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1699851325657.69269bc0d44ad4030e108151ca591d2f. 2023-11-13 04:56:15,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ce3aa54af75e8a2d70418cb3df223e32, disabling compactions & flushes 2023-11-13 04:56:15,363 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. 2023-11-13 04:56:15,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. 2023-11-13 04:56:15,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. after waiting 0 ms 2023-11-13 04:56:15,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. 2023-11-13 04:56:15,366 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ce3aa54af75e8a2d70418cb3df223e32/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-11-13 04:56:15,367 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. 2023-11-13 04:56:15,367 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ce3aa54af75e8a2d70418cb3df223e32: 2023-11-13 04:56:15,367 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699851260495.ce3aa54af75e8a2d70418cb3df223e32. 2023-11-13 04:56:15,367 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bfeed2e88ce202cf921374d6d67968c7, disabling compactions & flushes 2023-11-13 04:56:15,367 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7. 2023-11-13 04:56:15,367 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7. 2023-11-13 04:56:15,367 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7. after waiting 0 ms 2023-11-13 04:56:15,367 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7. 2023-11-13 04:56:15,370 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/bfeed2e88ce202cf921374d6d67968c7/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-13 04:56:15,371 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7. 2023-11-13 04:56:15,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bfeed2e88ce202cf921374d6d67968c7: 2023-11-13 04:56:15,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1699851300400.bfeed2e88ce202cf921374d6d67968c7. 2023-11-13 04:56:15,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6638aa08a24bc6e34e9840c49e638c8a, disabling compactions & flushes 2023-11-13 04:56:15,371 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a. 2023-11-13 04:56:15,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a. 2023-11-13 04:56:15,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a. after waiting 0 ms 2023-11-13 04:56:15,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a. 2023-11-13 04:56:15,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/6638aa08a24bc6e34e9840c49e638c8a/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-13 04:56:15,375 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a. 2023-11-13 04:56:15,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6638aa08a24bc6e34e9840c49e638c8a: 2023-11-13 04:56:15,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1699851300400.6638aa08a24bc6e34e9840c49e638c8a. 2023-11-13 04:56:15,376 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 93b1e59720a53a032a804bf4ec0ce192, disabling compactions & flushes 2023-11-13 04:56:15,376 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1699851325657.93b1e59720a53a032a804bf4ec0ce192. 2023-11-13 04:56:15,376 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1699851325657.93b1e59720a53a032a804bf4ec0ce192. 2023-11-13 04:56:15,376 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1699851325657.93b1e59720a53a032a804bf4ec0ce192. after waiting 0 ms 2023-11-13 04:56:15,376 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1699851325657.93b1e59720a53a032a804bf4ec0ce192. 2023-11-13 04:56:15,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/ns/testMinorCompaction/93b1e59720a53a032a804bf4ec0ce192/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-13 04:56:15,380 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1699851325657.93b1e59720a53a032a804bf4ec0ce192. 2023-11-13 04:56:15,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 93b1e59720a53a032a804bf4ec0ce192: 2023-11-13 04:56:15,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1699851325657.93b1e59720a53a032a804bf4ec0ce192. 2023-11-13 04:56:15,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 27cb223f9866bdc4989cc22b2513873e, disabling compactions & flushes 2023-11-13 04:56:15,380 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e. 2023-11-13 04:56:15,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e. 2023-11-13 04:56:15,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e. after waiting 0 ms 2023-11-13 04:56:15,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e. 2023-11-13 04:56:15,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMinorCompactionWithWeeklyPolicy/27cb223f9866bdc4989cc22b2513873e/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-11-13 04:56:15,384 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e. 2023-11-13 04:56:15,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 27cb223f9866bdc4989cc22b2513873e: 2023-11-13 04:56:15,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1699851230533.27cb223f9866bdc4989cc22b2513873e. 2023-11-13 04:56:15,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e04c69bd7378d342c6ee08c3af87ad84, disabling compactions & flushes 2023-11-13 04:56:15,384 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84. 2023-11-13 04:56:15,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84. 2023-11-13 04:56:15,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84. after waiting 0 ms 2023-11-13 04:56:15,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84. 2023-11-13 04:56:15,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e04c69bd7378d342c6ee08c3af87ad84/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-11-13 04:56:15,389 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84. 2023-11-13 04:56:15,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e04c69bd7378d342c6ee08c3af87ad84: 2023-11-13 04:56:15,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1699851204288.e04c69bd7378d342c6ee08c3af87ad84. 2023-11-13 04:56:15,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b118e2043963096bdb82baf7b4023e66, disabling compactions & flushes 2023-11-13 04:56:15,389 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1699851242251.b118e2043963096bdb82baf7b4023e66. 2023-11-13 04:56:15,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1699851242251.b118e2043963096bdb82baf7b4023e66. 2023-11-13 04:56:15,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1699851242251.b118e2043963096bdb82baf7b4023e66. after waiting 0 ms 2023-11-13 04:56:15,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1699851242251.b118e2043963096bdb82baf7b4023e66. 2023-11-13 04:56:15,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testScannerOnBulkLoadRefHFiles/b118e2043963096bdb82baf7b4023e66/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-11-13 04:56:15,392 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1699851242251.b118e2043963096bdb82baf7b4023e66. 2023-11-13 04:56:15,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b118e2043963096bdb82baf7b4023e66: 2023-11-13 04:56:15,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1699851242251.b118e2043963096bdb82baf7b4023e66. 2023-11-13 04:56:15,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e13efa47a2338bfc8c25006e697a36d8, disabling compactions & flushes 2023-11-13 04:56:15,392 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8. 2023-11-13 04:56:15,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8. 2023-11-13 04:56:15,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8. after waiting 0 ms 2023-11-13 04:56:15,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8. 2023-11-13 04:56:15,395 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testCompactionWithHFileLink/e13efa47a2338bfc8c25006e697a36d8/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-13 04:56:15,395 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8. 2023-11-13 04:56:15,395 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e13efa47a2338bfc8c25006e697a36d8: 2023-11-13 04:56:15,395 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1699851300400.e13efa47a2338bfc8c25006e697a36d8. 2023-11-13 04:56:15,395 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 812b4480b089b56a87a7dec53ca31d1a, disabling compactions & flushes 2023-11-13 04:56:15,395 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1699851356777.812b4480b089b56a87a7dec53ca31d1a. 2023-11-13 04:56:15,395 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1699851356777.812b4480b089b56a87a7dec53ca31d1a. 2023-11-13 04:56:15,395 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1699851356777.812b4480b089b56a87a7dec53ca31d1a. after waiting 0 ms 2023-11-13 04:56:15,395 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1699851356777.812b4480b089b56a87a7dec53ca31d1a. 2023-11-13 04:56:15,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/812b4480b089b56a87a7dec53ca31d1a/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-13 04:56:15,398 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1699851356777.812b4480b089b56a87a7dec53ca31d1a. 2023-11-13 04:56:15,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 812b4480b089b56a87a7dec53ca31d1a: 2023-11-13 04:56:15,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1699851356777.812b4480b089b56a87a7dec53ca31d1a. 2023-11-13 04:56:15,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f692c4768bba87d4f27f89747545abab, disabling compactions & flushes 2023-11-13 04:56:15,399 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1699851356777.f692c4768bba87d4f27f89747545abab. 2023-11-13 04:56:15,399 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1699851356777.f692c4768bba87d4f27f89747545abab. 2023-11-13 04:56:15,399 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1699851356777.f692c4768bba87d4f27f89747545abab. after waiting 0 ms 2023-11-13 04:56:15,399 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1699851356777.f692c4768bba87d4f27f89747545abab. 2023-11-13 04:56:15,401 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionFromAdmin/f692c4768bba87d4f27f89747545abab/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-13 04:56:15,402 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1699851356777.f692c4768bba87d4f27f89747545abab. 2023-11-13 04:56:15,402 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f692c4768bba87d4f27f89747545abab: 2023-11-13 04:56:15,402 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1699851356777.f692c4768bba87d4f27f89747545abab. 2023-11-13 04:56:15,402 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e238262ff621754c018596b9ec849ffa, disabling compactions & flushes 2023-11-13 04:56:15,402 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa. 2023-11-13 04:56:15,402 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa. 2023-11-13 04:56:15,402 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa. after waiting 0 ms 2023-11-13 04:56:15,402 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa. 2023-11-13 04:56:15,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testMajorCompactionWithMonthlyPolicy/e238262ff621754c018596b9ec849ffa/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-11-13 04:56:15,405 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa. 2023-11-13 04:56:15,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e238262ff621754c018596b9ec849ffa: 2023-11-13 04:56:15,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1699851217393.e238262ff621754c018596b9ec849ffa. 2023-11-13 04:56:15,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 65bf1eecde5a83e1bebe47c93d288912, disabling compactions & flushes 2023-11-13 04:56:15,405 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1699851242251.65bf1eecde5a83e1bebe47c93d288912. 2023-11-13 04:56:15,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1699851242251.65bf1eecde5a83e1bebe47c93d288912. 2023-11-13 04:56:15,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1699851242251.65bf1eecde5a83e1bebe47c93d288912. after waiting 0 ms 2023-11-13 04:56:15,406 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1699851242251.65bf1eecde5a83e1bebe47c93d288912. 2023-11-13 04:56:15,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testScannerOnBulkLoadRefHFiles/65bf1eecde5a83e1bebe47c93d288912/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-11-13 04:56:15,408 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1699851242251.65bf1eecde5a83e1bebe47c93d288912. 2023-11-13 04:56:15,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 65bf1eecde5a83e1bebe47c93d288912: 2023-11-13 04:56:15,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1699851242251.65bf1eecde5a83e1bebe47c93d288912. 2023-11-13 04:56:15,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 90df22d5e18546f877e84e0c244138f5, disabling compactions & flushes 2023-11-13 04:56:15,408 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1699851242251.90df22d5e18546f877e84e0c244138f5. 2023-11-13 04:56:15,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1699851242251.90df22d5e18546f877e84e0c244138f5. 2023-11-13 04:56:15,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1699851242251.90df22d5e18546f877e84e0c244138f5. after waiting 0 ms 2023-11-13 04:56:15,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1699851242251.90df22d5e18546f877e84e0c244138f5. 2023-11-13 04:56:15,410 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/data/default/testScannerOnBulkLoadRefHFiles/90df22d5e18546f877e84e0c244138f5/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-11-13 04:56:15,411 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1699851242251.90df22d5e18546f877e84e0c244138f5. 2023-11-13 04:56:15,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 90df22d5e18546f877e84e0c244138f5: 2023-11-13 04:56:15,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1699851242251.90df22d5e18546f877e84e0c244138f5. 2023-11-13 04:56:15,516 INFO [RS:0;jenkins-hbase4:41657] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,41657,1699851201532; all regions closed. 2023-11-13 04:56:15,523 DEBUG [RS:0;jenkins-hbase4:41657] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/oldWALs 2023-11-13 04:56:15,523 INFO [RS:0;jenkins-hbase4:41657] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41657%2C1699851201532.meta:.meta(num 1699851203180) 2023-11-13 04:56:15,527 DEBUG [RS:0;jenkins-hbase4:41657] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/oldWALs 2023-11-13 04:56:15,527 INFO [RS:0;jenkins-hbase4:41657] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41657%2C1699851201532:(num 1699851202993) 2023-11-13 04:56:15,527 DEBUG [RS:0;jenkins-hbase4:41657] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-13 04:56:15,527 INFO [RS:0;jenkins-hbase4:41657] regionserver.LeaseManager(133): Closed leases 2023-11-13 04:56:15,528 INFO [RS:0;jenkins-hbase4:41657] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-11-13 04:56:15,528 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-11-13 04:56:15,529 INFO [RS:0;jenkins-hbase4:41657] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41657 2023-11-13 04:56:15,537 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41657,1699851201532 2023-11-13 04:56:15,537 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-13 04:56:15,537 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-13 04:56:15,539 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41657,1699851201532] 2023-11-13 04:56:15,540 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41657,1699851201532; numProcessing=1 2023-11-13 04:56:15,542 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41657,1699851201532 already deleted, retry=false 2023-11-13 04:56:15,542 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase4.apache.org,41657,1699851201532 expired; onlineServers=0 2023-11-13 04:56:15,542 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,33831,1699851200322' ***** 2023-11-13 04:56:15,542 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-11-13 04:56:15,542 DEBUG [M:0;jenkins-hbase4:33831] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@72d3bc9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-11-13 04:56:15,542 INFO [M:0;jenkins-hbase4:33831] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,33831,1699851200322 2023-11-13 04:56:15,542 INFO [M:0;jenkins-hbase4:33831] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,33831,1699851200322; all regions closed. 2023-11-13 04:56:15,542 DEBUG [M:0;jenkins-hbase4:33831] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-13 04:56:15,542 DEBUG [M:0;jenkins-hbase4:33831] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-11-13 04:56:15,542 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-11-13 04:56:15,543 DEBUG [M:0;jenkins-hbase4:33831] cleaner.HFileCleaner(317): Stopping file delete threads 2023-11-13 04:56:15,543 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1699851202689] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1699851202689,5,FailOnTimeoutGroup] 2023-11-13 04:56:15,543 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1699851202689] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1699851202689,5,FailOnTimeoutGroup] 2023-11-13 04:56:15,543 INFO [M:0;jenkins-hbase4:33831] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-11-13 04:56:15,543 INFO [M:0;jenkins-hbase4:33831] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-11-13 04:56:15,543 INFO [M:0;jenkins-hbase4:33831] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-11-13 04:56:15,543 DEBUG [M:0;jenkins-hbase4:33831] master.HMaster(1512): Stopping service threads 2023-11-13 04:56:15,543 INFO [M:0;jenkins-hbase4:33831] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-11-13 04:56:15,544 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-11-13 04:56:15,544 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-13 04:56:15,544 ERROR [M:0;jenkins-hbase4:33831] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-11-13 04:56:15,544 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-13 04:56:15,544 INFO [M:0;jenkins-hbase4:33831] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-11-13 04:56:15,545 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-11-13 04:56:15,546 DEBUG [M:0;jenkins-hbase4:33831] zookeeper.ZKUtil(398): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-11-13 04:56:15,546 WARN [M:0;jenkins-hbase4:33831] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-11-13 04:56:15,546 INFO [M:0;jenkins-hbase4:33831] assignment.AssignmentManager(315): Stopping assignment manager 2023-11-13 04:56:15,546 INFO [M:0;jenkins-hbase4:33831] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-11-13 04:56:15,546 DEBUG [M:0;jenkins-hbase4:33831] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-11-13 04:56:15,546 INFO [M:0;jenkins-hbase4:33831] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-13 04:56:15,546 DEBUG [M:0;jenkins-hbase4:33831] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-13 04:56:15,546 DEBUG [M:0;jenkins-hbase4:33831] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-11-13 04:56:15,546 DEBUG [M:0;jenkins-hbase4:33831] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-13 04:56:15,546 INFO [M:0;jenkins-hbase4:33831] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=512.50 KB heapSize=598.23 KB 2023-11-13 04:56:15,639 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-13 04:56:15,639 INFO [RS:0;jenkins-hbase4:41657] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,41657,1699851201532; zookeeper connection closed. 2023-11-13 04:56:15,639 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): regionserver:41657-0x101ddc61b680001, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-13 04:56:15,640 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4e211329] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4e211329 2023-11-13 04:56:15,640 INFO [Listener at localhost/34517] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-11-13 04:56:15,954 INFO [M:0;jenkins-hbase4:33831] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=512.50 KB at sequenceid=1005 (bloomFilter=true), to=hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/3cbd1b5f280a45cc82c110535685db9c 2023-11-13 04:56:15,958 INFO [M:0;jenkins-hbase4:33831] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3cbd1b5f280a45cc82c110535685db9c 2023-11-13 04:56:15,959 DEBUG [M:0;jenkins-hbase4:33831] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/3cbd1b5f280a45cc82c110535685db9c as hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/3cbd1b5f280a45cc82c110535685db9c 2023-11-13 04:56:15,963 INFO [M:0;jenkins-hbase4:33831] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3cbd1b5f280a45cc82c110535685db9c 2023-11-13 04:56:15,963 INFO [M:0;jenkins-hbase4:33831] regionserver.HStore(1080): Added hdfs://localhost:39509/user/jenkins/test-data/21720b4c-5c41-da25-6771-7d2cfc9e0cc4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/3cbd1b5f280a45cc82c110535685db9c, entries=123, sequenceid=1005, filesize=33.3 K 2023-11-13 04:56:15,963 INFO [M:0;jenkins-hbase4:33831] regionserver.HRegion(2948): Finished flush of dataSize ~512.50 KB/524805, heapSize ~598.21 KB/612568, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 417ms, sequenceid=1005, compaction requested=false 2023-11-13 04:56:15,964 INFO [M:0;jenkins-hbase4:33831] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-13 04:56:15,964 DEBUG [M:0;jenkins-hbase4:33831] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-13 04:56:15,967 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-11-13 04:56:15,967 INFO [M:0;jenkins-hbase4:33831] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-11-13 04:56:15,968 INFO [M:0;jenkins-hbase4:33831] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33831 2023-11-13 04:56:15,970 DEBUG [M:0;jenkins-hbase4:33831] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,33831,1699851200322 already deleted, retry=false 2023-11-13 04:56:16,076 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-13 04:56:16,076 INFO [M:0;jenkins-hbase4:33831] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,33831,1699851200322; zookeeper connection closed. 2023-11-13 04:56:16,076 DEBUG [Listener at localhost/34517-EventThread] zookeeper.ZKWatcher(600): master:33831-0x101ddc61b680000, quorum=127.0.0.1:51072, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-13 04:56:16,078 WARN [Listener at localhost/34517] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-11-13 04:56:16,082 INFO [Listener at localhost/34517] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-11-13 04:56:16,188 WARN [BP-1062116304-172.31.14.131-1699851196904 heartbeating to localhost/127.0.0.1:39509] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-11-13 04:56:16,188 WARN [BP-1062116304-172.31.14.131-1699851196904 heartbeating to localhost/127.0.0.1:39509] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1062116304-172.31.14.131-1699851196904 (Datanode Uuid c05bfce7-1702-4e81-a2e6-d726294a2082) service to localhost/127.0.0.1:39509 2023-11-13 04:56:16,191 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c16da608-f133-6e06-11cc-7a1f39f7083b/cluster_96bef9f4-be45-971b-7755-f6017f1a70ff/dfs/data/data1/current/BP-1062116304-172.31.14.131-1699851196904] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-11-13 04:56:16,191 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c16da608-f133-6e06-11cc-7a1f39f7083b/cluster_96bef9f4-be45-971b-7755-f6017f1a70ff/dfs/data/data2/current/BP-1062116304-172.31.14.131-1699851196904] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-11-13 04:56:16,217 INFO [Listener at localhost/34517] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-11-13 04:56:16,351 INFO [Listener at localhost/34517] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-11-13 04:56:16,452 INFO [Listener at localhost/34517] hbase.HBaseTestingUtility(1293): Minicluster is down